Available
DeepInfra
Serverless inference for open-source models via DeepInfra. Free trial credits available.
Models
meta-llama/Llama-3.3-70B-Instruct
deepseek-ai/DeepSeek-V3
Qwen/Qwen2.5-72B-Instruct
Capabilities
✓ Text✓ Tools✓ Streaming
Setup
- Create an account at deepinfra.com
- Receive free trial credits on signup
- Generate an API key from the dashboard
Configuration
Base URL: https://api.deepinfra.com/v1/openai Environment variable: DEEPINFRA_API_KEY=... Or configure via dashboard: Dashboard → Provider Keys → Add Key → deepinfra
Example
curl https://your-bifrost-url/api/chat/completions \
-H "Authorization: Bearer $BIFROST_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "meta-llama/Llama-3.3-70B-Instruct",
"messages": [{"role": "user", "content": "Hello!"}]
}'