Auto Routing
Never depend on one model. Bifrost selects the optimal route automatically.
How routing works
REQUEST
↓TASK CLASSIFICATION
↓CAPABILITY FILTER
↓POLICY FILTER
↓COST / LATENCY ANALYSIS
↓PROVIDER HEALTH
↓QUOTA
↓ROUTE SCORING
↓BEST ROUTE
Routing factors
Bifrost considers:
Task requirements
Model capabilities
Context size
Output requirements
Cost
Latency
Provider health
Quota
Historical performance
Tenant policy
Data residency
Fallback availability
Scoring weights
| Factor | Weight |
|---|---|
| Capability match | 30% |
| Quality | 25% |
| Reliability | 15% |
| Cost efficiency | 15% |
| Latency | 10% |
| Availability | 5% |
Candidate models
Example routing candidates for a coding task:
Claude Sonnet 4Anthropic
82GPT-4oOpenAI
76Gemini 2.5 FlashGoogle
71Llama 3.3 70BGroq
68