BIFROST
Dashboard
Operational

Lepton AI

Run and serve models with a free tier on Lepton AI.

Setup

1. Create an account at lepton.ai.
2. Navigate to API keys in the dashboard.
3. Generate a new API key.
4. Set the environment variable below.

API Key

LEPTON_API_KEY=...

Base URL

https://api.lepton.ai/api/v1

Models

llama-3.3-70b-instruct
qwen-72b-chat

Capabilities

TextStreamingTools

Example

curl https://api.lepton.ai/api/v1/chat/completions \
  -H "Authorization: Bearer $LEPTON_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "llama-3.3-70b-instruct",
    "messages": [{"role": "user", "content": "Hello"}]
  }'
← Previous
Novita AI
Next →
Hyperbolic