AI Providers

LiteLLM calls every provider below through one OpenAI-format API. Set the model as <prefix>/<model-name>, for example anthropic/claude-sonnet-5, and the same request works from the Python SDK and the Gateway. Open a provider for its keys, setup, and supported parameters. Prices and context windows for each model are on Models & Pricing.

Popular

OpenAIChat, embeddings, images, audio, video and vector stores6 pagesopenai/AnthropicChat3 pagesanthropic/Google AI StudioChat, embeddings, images, audio, video and vector stores7 pagesgemini/Gemini Enterprise Agent PlatformChat, embeddings, images, audio, video, rerank and vector stores12 pagesvertex_ai/Azure OpenAIChat, embeddings, images, audio, video and vector stores5 pagesazure/Azure AIChat, embeddings, images, audio, rerank and vector stores9 pagesazure_ai/BedrockChat, embeddings, images, audio, rerank and vector stores13 pagesbedrock/Mistral AIChat, embeddings and audio2 pagesmistral/xAIChat, images, audio and video3 pagesxai/DeepseekChatdeepseek/GroqChat and audiogroq/

Self-Hosted & Local

OllamaChat and embeddingsollama/vLLMChat, embeddings, images, audio, video and rerank2 pagesvllm/LM StudioChat and embeddingslm_studio/LLlamafileChatllamafile/DDocker Model RunnerChatdocker_model_runner/LLemonadeChatlemonade/Triton Inference ServerChat and embeddingstriton/Xinference [Xorbits Inference]Embeddings and imagesxinference/InfinityEmbeddings and rerankinfinity/Nvidia NIMChat and rerank2 pagesnvidia_nim/PPetalsChatpetals/CCustom API Server (Custom Format)Chat and embeddingscustom/

Gateways & OpenAI-Compatible

OOpenAI-Compatible EndpointsChat and embeddingscustom_openai/LLiteLLM Proxy (LLM Gateway)Chat, embeddings, images, audio and reranklitellm_proxy/OpenRouterChat, embeddings and imagesopenrouter/OOpenCode GoChatopencode_go/Vercel AI GatewayChat and embeddingsvercel_ai_gateway/HHeliconeChathelicone/CometAPIChat, embeddings and imagescometapi/CCLF AI GatewayChatPPoeChatpoe/

Vector Stores

Milvus - Vector StoreVector storesmilvus/MMongoDB - Vector Store (BETA)Vector storesmongodb/AWS S3 VectorsVector storess3_vectors/Valkey - Vector StoreVector storesvalkey/RRAGFlow Vector StoresVector stores

Agent Providers

LangGraphChatlanggraph/Pydantic AI AgentsAgent Providerspydantic_ai_agents/

More Providers A-Z

AAbliterationChatabliteration/AI21Chatai21/AI/ML APIChat, embeddings and imagesaiml/AAleph AlphaChatAAmazon NovaChatamazon_nova/AAnyscaleChatanyscale/AApertis AI (Stima API)Chatapertis/AWS SagemakerChat and embeddingssagemaker/BasetenChatbaseten/BBlack Forest Labs Image GenerationImagesblack_forest_labs/BBlack Forest Labs Image EditingImagesBBytezChatbytez/CerebrasChatcerebras/ChatGPT SubscriptionChatchatgpt/CChutesChatchutes/CClarifaiChatclarifai/Cloudflare Workers AIChat and audiocloudflare/Codestral API [Mistral AI]Chatcodestral/CCognitionChatcognition/CohereChat, embeddings and rerankcohere/CCompactifAIChatcompactifai/CCoralBricksChatcoralbricks/CCrusoeChatcrusoe/Dashscope API (Qwen models)Chat, embeddings, images, video and rerankdashscope/DatabricksChat, embeddings and imagesdatabricks/DDataRobotChatdatarobot/DeepgramAudiodeepgram/DeepInfraChat and rerankdeepinfra/EEden AIChat, embeddings, images, audio and videoedenai/ElevenLabsAudioelevenlabs/EEmpirioLabs AIChatempiriolabs/Fal AIChat, images and videofal_ai/Featherless AIChatfeatherless_ai/Fireworks AIChat, embeddings, images, audio and rerankfireworks_ai/FriendliAIChatfriendliai/GGaladrielChatgaladriel/GithubChatgithub/GitHub CopilotChat and embeddingsgithub_copilot/GGMI CloudChatgmi/GGradientAIChatgradient_ai/HHerokuChatheroku/HuggingFaceChat, embeddings and rerank2 pageshuggingface/HyperbolicChathyperbolic/IInceptionChatinception/IInference APIsChatinferenceapis/Jina AIEmbeddings and rerankjina_ai/Lambda AIChatlambda_ai/LLlamaGateChat and embeddingsllamagate/MManusChatmanus/MMeta Model APIChat, images and audiometa/Meta LlamaChatmeta_llama/MMicrosoft 365 CopilotChatmicrosoft_365_copilot/MiniMaxChat, audio and videominimax/Moonshot AIChatmoonshot/MorphChatmorph/NNadirChatnadir/NNanoGPTChatnanogpt/Nebius AI StudioChat and embeddingsnebius/NNeosantaraChatneosantara/NNLP CloudChatnlp_cloud/Novita AIChat, embeddings and reranknovita/NNscale (EU Sovereign)Chat and imagesnscale/NNvidia Riva (Speech-to-Text)Audionvidia_riva/Oracle Cloud Infrastructure (OCI)Chat and embeddingsoci/OOpenInferChatopeninfer/OOVHCloud AI EndpointsChat, embeddings and audioovhcloud/Perplexity AIChat and embeddings2 pagesperplexity/PPredibaseChatpredibase/PPrismChatprism/PPublicAIChatpublicai/QwenCloud and Qianwen AI Platform (Qwen models)Chat, embeddings, images, video and rerankqwencloud/RRAGFlowChat and vector storesragflow/RecraftImagesrecraft/RRefuselessChatrefuseless/RRekaChatreka/ReplicateChatreplicate/RunwayMLImages, audio and video2 pagesrunwayml/SambaNovaChat and embeddingssambanova/SAP Generative AI HubChat and embeddingssap/SSarvam.aiChatsarvam/SScaleDownChatscaledown/SScalewayChat, embeddings, audio and rerankscaleway/SCX.aiChatscx-ai/Snowflake CortexChat and embeddingssnowflake/SStability AIImagesstability/SStrands DeciderMore Providers A-Zstrands_decider/SSyntheticChatsynthetic/TTencent TokenHubChat and imagestencent/TTensormeshChattensormesh/Together AIChat, embeddings and reranktogether_ai/TopazImagestopaz/v0Chatv0/Volcano Engine (Volcengine)Chat, embeddings and videovolcengine/VoyageAI by MongoDBEmbeddings and rerankvoyage/WWeights & Biases InferenceChatwandb/WatsonXChat, embeddings, audio and rerank2 pageswatsonx/XXiaomi MiMoChatxiaomi_mimo/ZZ.AI (Zhipu AI)Chatzai/ZZeroGPUChatzerogpu/

Guides

• Fine-tuned Models
• Integrate as a Model Provider
• Add OpenAI-Compatible Provider (JSON)
• Add Model Pricing & Context Window