LiteLLM
LLM Gateways & APIs · Free
Unified API gateway for 100+ LLM providers
At a glance
- Made by
- BerriAI
- Korean
- None (English and a few others only)
- API
- Yes
- Available on
- API, Mac, Linux, Windows
- Open source
- Open source (the license name is not listed on the page)
- GitHub
- 61,199 stars · NOASSERTION
What is LiteLLM?
LiteLLM is an open-source, self-hosted AI gateway that lets you call more than 100 LLM providers, including OpenAI, Anthropic, Gemini, Bedrock, and Azure, through a single OpenAI-format interface. You can use it like a library through the Python SDK, or deploy it as a proxy server to serve as a central gateway for a team or organization. It issues virtual keys with budgets and rate limits per app or person, records the cost of each request, and connects MCP tools and A2A agents through the same gateway.
- Single OpenAI-compatible API (140+ providers, 1,800+ models)
- Virtual keys, budgets, and rate limits
- Per-request cost (spend) tracking
- Guardrails (PII masking, prompt injection, etc.)
- SSO login and team/project scoping
- MCP gateway
- Agent (A2A) gateway
- Python SDK (streaming, retries, fallback)
Who uses LiteLLM and for what
- Platform teams opening access to all models company-wide while controlling spend
- Swapping backend models without changing app code
Pricing
What you get for free — Open-source and self-hosted (no pricing table of its own on the page)
| Plan | Price | Main limits |
|---|---|---|
| Enterprise | Contact sales | Pricing not listed; contact sales |
Checked on the official pages on 2026-10-14. Prices and features can change, so check the official site again before paying.
Combos that work well with LiteLLM
Per-model cost, quality, and incident response
ChatGPT routes between low-cost and high-performance models based on task difficulty and expected tokens. In the LiteLLM + OpenRouter + PortKey combo, the gateway consistently applies key management, call logs, and fallback model policies. Sample evaluations, error rates, and costs are compared to adjust routing rules periodically.
Cost: API pay-as-you-go + subscription (ChatGPT) / open source + mixed pay-as-you-go/subscription
Per-model cost, quality, and incident response
Claude routes between low-cost and high-performance models based on task difficulty and expected tokens. In the LiteLLM + OpenRouter + PortKey combo, the gateway consistently applies key management, call logs, and fallback model policies. Routing rules are adjusted periodically by comparing sample evaluations, error rates, and cost.
Cost: Freemium (free + paid subscription) + API pay-as-you-go / open source + mixed pay-as-you-go/subscription
Per-model cost, quality, and incident response
Gemini routes between low-cost and high-performance models based on task difficulty and expected tokens. In the LiteLLM + OpenRouter + PortKey combo, the gateway applies key management, call logs, and fallback model policies consistently. Routing rules are adjusted periodically by comparing sample evaluations, error rates, and costs.
Cost: Freemium (free + paid subscription) + API pay-as-you-go / open source + mixed pay-as-you-go/subscription
Per-model cost, quality, and incident response
DeepSeek routes between low-cost and high-performance models based on task difficulty and expected tokens. In the LiteLLM + OpenRouter + PortKey combo, the gateway applies key management, call logs, and fallback model policies consistently. Routing rules are adjusted periodically by comparing sample evaluations, error rates, and costs.
Cost: Open source (free) + API pay-as-you-go / open source + mixed pay-as-you-go/subscription
Per-model cost, quality, and incident response
Perplexity routes between low-cost and high-performance models based on task difficulty and expected tokens. In the LiteLLM + OpenRouter + PortKey combo, the gateway applies key management, call logs, and fallback model policies consistently. Sample evaluations, error rates, and costs are compared to adjust the routing rules periodically.
Cost: Freemium (free + paid subscription) / open source + mixed pay-as-you-go/subscription
Per-model cost, quality, and incident response
Grok-2 routes between low-cost and high-performance models based on task difficulty and expected tokens. The LiteLLM + OpenRouter + PortKey combo has the gateway apply key management, call logs, and fallback model policies consistently. Sample evaluations, error rates, and costs are compared to adjust routing rules periodically.
Cost: Subscription (including X subscription) + API pay-as-you-go / Open source + mixed pay-as-you-go/subscription
Per-model cost, quality, and incident response
Llama routes tasks to low-cost or high-performance models based on task difficulty and expected tokens. In the LiteLLM + OpenRouter + PortKey combo, the gateway consistently applies key management, call logging, and fallback model policies. Routing rules are adjusted periodically by comparing sample evaluations, error rates, and cost.
Cost: Open source (free, license conditions apply) / Open source + mixed pay-as-you-go/subscription
Per-model cost, quality, and incident response
Mistral routes tasks to low-cost or high-performance models based on task difficulty and expected tokens. In the LiteLLM + OpenRouter + PortKey combo, the gateway consistently applies key management, call logging, and fallback model policies. Routing rules are adjusted periodically by comparing sample evaluations, error rates, and cost.
Cost: Open source (free) + API pay-as-you-go / open source + mixed pay-as-you-go/subscription
AI tools similar to LiteLLM (alternatives)
LiteLLM vs. alternatives at a glance
| AI | Pricing | Combos on the map | Connected tools | Free | Cheapest monthly | Korean |
|---|---|---|---|---|---|---|
| LiteLLM | Free | 10 | 5 | No | — | No |
| Cloudflare AI Gateway | Free + paid | 0 | 5 | Yes | — | Yes |
| OpenRouter | Free + paid | 10 | 5 | Yes | — | No |
| PortKey | Free + paid | 10 | 5 | Yes | $49/mo | No |
| Vercel AI Gateway | Free + paid | 10 | 5 | Yes | $5/mo | No |
4 of these 5 tools have a free plan. Cheapest paid plan: Vercel AI Gateway ($5/mo).
Combo and connection counts are based on the relationships recorded on AI Galaxy Map (2026-10-26); they are not a quality ranking.
LiteLLM on AI Galaxy Map
- One of 14 AI tools in the LLM Gateways & APIs field.
- Connected to 5 other tools — #6 in its field.
- Part of 10 work combos recorded on the map.
Frequently asked questions
Can I use LiteLLM for free?
Open-source and self-hosted (no pricing table of its own on the page). Prices can change, so check the official site before paying.
What works well with LiteLLM?
Based on the combos on the map, there is a workflow such as "Per-model cost, quality, and incident response" that uses it together with GPT, OpenRouter, PortKey.
What AI can I use instead of LiteLLM?
Tools that do the same job, such as Cloudflare AI Gateway, OpenRouter, PortKey, Vercel AI Gateway, are connected to it on the map.
Can I use LiteLLM in Korean?
None (English and a few others only)
Sources (official pages)
Checked on the official pages on 2026-10-14. Prices and features can change, so check the official site again before paying.