Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]
GitHub repository
https://github.com/BerriAI/litellmLicense
Other
Stars
62,616
Homepage
https://docs.litellm.ai/docs/This is an independent tool overview. Check the project repository for current releases, compatibility, and installation requirements.