Other · Large Language Models (LLMs)
LiteLLM
LiteLLM simplifies LLM completion and embedding calls with an open-source library.
Open source
- Website
- litellm.ai
- Category
- Other › Large Language Models (LLMs)
- Pricing
- Open source
- Platforms
- website
About LiteLLM
LiteLLM is the open-source AI gateway that puts your full AI stack behind one OpenAI-compatible key. Track and cap LLM spend, route to the right model, and self-host anywhere — even air-gapped. 140+ providers, 1,892 models. “LiteLLM gives NVIDIA engineers a single, consistent way to access more than 100 AI model endpoints .” “LiteLLM streamlines the complexities of managing multiple LLM models.” “LiteLLM has let my team provide the latest LLM models to our users, usually within a day of them being released… it has saved us months of work .” “If we decide to switch the backend model, it’s a simple configuration update in the gateway; no code changes, procurement cycles, or repetitive security reviews required.”
Features
Optimization Observability Routing Governance
Optimization
Observability
100+ providers, one OpenAI API
Day-0 access to new models
Virtual keys, budgets, rate limits
Spend by key / user / team / org
Tag-based spend tracking
