LiteLLM Has a Free API — Unified Proxy for 100+ LLM Providers

LiteLLM is a unified API gateway that lets you call 100+ LLM providers using the same OpenAI-compatible format. Switch between OpenAI, Anthropic, Bedrock, Vertex AI, Ollama, and more — without changing your code. Free, open source, Python-native. Used by thousands of companies for LLM routing. Why Use LiteLLM? One interface, 100+ providers — OpenAI, Anthropic, AWS Bedrock, Google Vertex, Azure, Cohere, Replicate, Ollama, and more OpenAI-compatible proxy — deploy as a server, use with any OpenAI SDK Cost tracking — track spend per model, per user, per team Load balancing — route between multiple API keys/deployments Fallbacks — automatic retry with different providers Rate limiting — per-user and per-model rate limits Quick Setup 1. Install pip install litellm[proxy] # Start proxy server litellm --model gpt-4o --port 4000 2. Use as Python Library from litellm import completion import os os . environ [ " OPENAI_API_KEY " ] = " sk-... " os . environ [ " ANTHROPIC_API_KEY " ] = " sk-ant-..