Operational
Lepton AI
Run and serve models with a free tier on Lepton AI.
Setup
1. Create an account at lepton.ai.
2. Navigate to API keys in the dashboard.
3. Generate a new API key.
4. Set the environment variable below.
API Key
LEPTON_API_KEY=...
Base URL
https://api.lepton.ai/api/v1
Models
llama-3.3-70b-instruct
qwen-72b-chat
Capabilities
✓ Text✓ Streaming✓ Tools
Example
curl https://api.lepton.ai/api/v1/chat/completions \
-H "Authorization: Bearer $LEPTON_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "llama-3.3-70b-instruct",
"messages": [{"role": "user", "content": "Hello"}]
}'