BIFROST
Dashboard
Operational

Nscale

Free-tier GPU inference via Nscale.

Setup

1. Create an account at nscale.com.
2. Generate an API key from the dashboard.
3. Set the environment variable below.

API Key

NSCALE_API_KEY=...

Base URL

https://api.nscale.com/v1

Models

nvidia/llama-3.1-8b-instruct

Capabilities

TextStreamingTools

Example

curl https://api.nscale.com/v1/chat/completions \
  -H "Authorization: Bearer $NSCALE_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "nvidia/llama-3.1-8b-instruct",
    "messages": [{"role": "user", "content": "Hello"}]
  }'
← Previous
Nvidia NIM
Next →
Together AI