Web app
Berri AI
LiteLLM is an open-source AI gateway that provides a unified API for accessing 140+ LLM providers and 1,800+ models. It enables platform teams to manage access, monitor usage, control costs, and route requests across models, agents, and MCP servers.
- Platform
- Web app
- Categories
- No-Code&Low-Code, AI App Builder, AI API Design, AI Developer Tools
- Indexed
- 2024-02-19
About Berri AI
What is LiteLLM
LiteLLM is an open-source AI gateway designed for platform teams. It puts an entire AI stack behind a single OpenAI-compatible API key, allowing organizations to access over 140 providers and 1,800+ models through one interface. The gateway supports self-hosting, including air-gapped environments, and is used in production by companies like NVIDIA, Netflix, and Okta. It handles key management, integrates with existing secret managers, and provides day-zero support for new models.
Key features
LiteLLM offers a unified API for LLMs, agents, and MCP servers, with one login and SSO scoped by team or project. It provides visibility into spend and usage, with the ability to set budgets and rate limits. The gateway includes routing capabilities to direct requests to the most appropriate model, and supports bring-your-own internal or fine-tuned models. It also offers security controls such as PII masking, prompt injection detection, and secret detection, and can be deployed with sub-millisecond overhead.
Use cases
Platform teams use LiteLLM to give their organization access to a wide range of AI models without exposing individual API keys. It is used to manage and monitor AI spend across teams, enforce budgets, and ensure compliance with security policies. Developers benefit from a consistent API that allows them to switch models without changing code. The gateway also enables access to agents and MCP servers, making it a central hub for AI resources in an enterprise.
Pricing
LiteLLM is open-source and can be self-hosted for free. The page mentions 'plans' and encourages users to 'learn more about our plans' and 'start free', but does not provide specific pricing details. For enterprise features and support, users are directed to contact sales.
Questions
Berri AI FAQ
- What is Berri AI?
- Berri AI is an AI tool available as a web app in the No-Code&Low-Code, AI App Builder, AI API Design categories. LiteLLM is an open-source AI gateway that provides a unified API for accessing 140+ LLM providers and 1,800+ models. It enables platform teams to manage access, monitor usage, control costs, and route requests across models, agents, and MCP servers.
- What is Berri AI used for?
- Berri AI is filed under No-Code&Low-Code, AI App Builder, AI API Design, AI Developer Tools in the AITOOLIST index. LiteLLM is an open-source AI gateway that provides a unified API for accessing 140+ LLM providers and 1,800+ models. It enables platform teams to manage access, monitor usage, control costs, and route requests across models, agents, and MCP servers.
- Is Berri AI a web app, an extension or a native app?
- Berri AI is a web app.
Listed in the AITOOLIST index since 2024-02-19.