Open Internet by MindsNet

Litellm

Litellm: Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM] Language: Python. Stars: 51,810. Trending on GitHub this week.

Computing & Technology, Computer Science, Artificial Intelligence