63
Views
0
Saves
About TheRouter.ai
TheRouter.ai is a hosted AI infrastructure layer that puts OpenAI, Anthropic, Google, DeepSeek, Qwen and 20+ other providers behind a single OpenAI-compatible endpoint. It adds health-aware routing with automatic failover, BYOK support with AWS KMS-encrypted keys, per-request cost tracking and governance controls, billed pay-as-you-go from your TheRouter balance.
Updated 11/3/2026
Key Features
- Unified API — One OpenAI-compatible endpoint and key for 269+ models across 26 providers
- Smart routing — Health-aware provider selection with automatic failover when one goes down
- BYOK — Keep your own provider accounts; keys sealed with AWS KMS envelope encryption
- Cost visibility — Real-time token and spend tracking per API key, with limits and budget alerts
- Approved Model Basket — Shadow-test cheaper approved models, then opt in to live cost routing (Beta)
- Prompt caching — Cache hits billed at the vendor's published cached input rate
- Audit trail — Per-request logs showing baseline cost, selected route and realized savings
- Zero data retention by default — Prompts are not stored; provider ordering can be pinned deterministically
- Drop-in clients — Works with Cursor, Claude Code, LangChain, Vercel AI SDK and any OpenAI-compatible app
Pricing Structure
- Pay-as-you-go — Usage-based — Per-model token rates, e.g. GPT-4o $2.70 / $10.80 per 1M.
- BYOK — Usage-based — Your own provider keys; a platform fee may apply.
Why People Use It
TheRouter is for teams that already hold provider accounts and do not want to lock into a single vendor's gateway. It keeps your existing contracts and pricing, then adds the layer those contracts lack: failover when a provider degrades, one place to see what every key and team is spending, and an audit trail you can reconcile against the invoice. Because it is OpenAI-SDK compatible, switching a model or provider is a one-string change rather than a rewrite.
See TheRouter.ai in Action
0
selected