Overview
FastRouter is a control plane for teams running LLMs in production. Instead of wiring each provider separately, you point your app at one OpenAI-compatible endpoint and let it decide which provider serves each request — cheapest, fastest, or highest-throughput — with automatic failover. The “zero markup” model is the headline: you pay providers’ token prices directly, and plan fees cover the platform only. Our evaluation likes this for cost-conscious engineering teams; the Flex suffix (append :flex) can roughly halve token bills on non-interactive workloads by routing to economy tiers. The main friction is the pricing staircase — the free Starter is generous, but the jump to $199/mo Pro is steep for a small project, and self-hosting is reserved for Enterprise.
Key Features
- One OpenAI-compatible API spanning 200+ models for text, image, video, embeddings, and voice
- Provider routing that picks the cheapest, lowest-latency, or highest-throughput source per request
- Flex tier via
:flexsuffix to cut token costs ~50% on batch and offline jobs - Automatic retries, fallback models, and virtual model aliases for seamless provider swaps
- Governance with project budgets, API-key limits, RBAC, rate limits, and spend alerts
- Observability dashboard plus weekly billing-optimization insights
Pricing
| Plan | Price | For |
|---|---|---|
| Starter | $0/mo | Free forever, 1M requests/mo, 1 BYOK key, $0 markup |
| Pro | $199/mo | 5M requests/mo, 10 orgs, caching, tracing, guardrails |
| Business | $799/mo | 50M requests/mo, 100 orgs, provisioning keys, 2-day SLA |
| Enterprise | Custom | Self-hosted, unlimited logs, dedicated Slack + SLA |
All tiers pass model costs through at $0 markup; plan fees cover the platform only.
Comparison
Versus Together, which is itself an inference provider, FastRouter sits above providers as a routing layer you can point at Together and dozens of others at once. Compared to Fal, which specializes in media inference, FastRouter is broader and provider-agnostic for general LLM traffic. Against Hopscotch, both offer unified gateways, but FastRouter’s explicit provider-sorting and Flex tier give finer cost control for high-volume teams.