--- title: "AI Providers" url: "/docs/providers" canonical_url: "https://docs.litellm.ai/docs/providers" type: "docs" last_updated: "2026-10-28" summary: "Every model provider LiteLLM supports, with the endpoints each one serves. Call any of them from the Python SDK or the LiteLLM Gateway through one OpenAI-format API." related: - "/docs/providers/openai" --- # AI Providers > Index of all LiteLLM docs: https://docs.litellm.ai/llms.txt LiteLLM calls every provider below through one OpenAI-format API. Set the model as `/`, for example `anthropic/claude-sonnet-5`, and the same request works from the Python SDK and the Gateway. Open a provider for its keys, setup, and supported parameters. Prices and context windows for each model are on [Models & Pricing](https://models.litellm.ai). ## Popular - [OpenAI](https://docs.litellm.ai/docs/providers/openai.md) - [Anthropic](https://docs.litellm.ai/docs/providers/anthropic.md) - [Google AI Studio](https://docs.litellm.ai/docs/providers/gemini.md) - [Gemini Enterprise Agent Platform](https://docs.litellm.ai/docs/providers/vertex.md) - [Azure OpenAI](https://docs.litellm.ai/docs/providers/azure/index.md) - [Azure AI](https://docs.litellm.ai/docs/providers/azure_ai.md) - [Bedrock](https://docs.litellm.ai/docs/providers/bedrock.md) - [Mistral AI](https://docs.litellm.ai/docs/providers/mistral.md) - [xAI](https://docs.litellm.ai/docs/providers/xai.md) - [Deepseek](https://docs.litellm.ai/docs/providers/deepseek.md) - [Groq](https://docs.litellm.ai/docs/providers/groq.md) ## Self-Hosted & Local - [Ollama](https://docs.litellm.ai/docs/providers/ollama.md) - [vLLM](https://docs.litellm.ai/docs/providers/vllm.md) - [LM Studio](https://docs.litellm.ai/docs/providers/lm_studio.md) - [Llamafile](https://docs.litellm.ai/docs/providers/llamafile.md) - [Docker Model Runner](https://docs.litellm.ai/docs/providers/docker_model_runner.md) - [Lemonade](https://docs.litellm.ai/docs/providers/lemonade.md) - [Triton Inference Server](https://docs.litellm.ai/docs/providers/triton-inference-server.md) - [Xinference [Xorbits Inference]](https://docs.litellm.ai/docs/providers/xinference.md) - [Infinity](https://docs.litellm.ai/docs/providers/infinity.md) - [Nvidia NIM](https://docs.litellm.ai/docs/providers/nvidia_nim.md) - [Petals](https://docs.litellm.ai/docs/providers/petals.md) - [Custom API Server (Custom Format)](https://docs.litellm.ai/docs/providers/custom_llm_server.md) ## Gateways & OpenAI-Compatible - [OpenAI-Compatible Endpoints](https://docs.litellm.ai/docs/providers/openai_compatible.md) - [LiteLLM Proxy (LLM Gateway)](https://docs.litellm.ai/docs/providers/litellm_proxy.md) - [OpenRouter](https://docs.litellm.ai/docs/providers/openrouter.md) - [OpenCode Go](https://docs.litellm.ai/docs/providers/opencode_go.md) - [Vercel AI Gateway](https://docs.litellm.ai/docs/providers/vercel_ai_gateway.md) - [Helicone](https://docs.litellm.ai/docs/providers/helicone.md) - [CometAPI](https://docs.litellm.ai/docs/providers/cometapi.md) - [CLF AI Gateway](https://docs.litellm.ai/docs/providers/clf_ai_gateway.md) - [Poe](https://docs.litellm.ai/docs/providers/poe.md) ## Vector Stores - [Milvus - Vector Store](https://docs.litellm.ai/docs/providers/milvus_vector_stores.md) - [MongoDB - Vector Store (BETA)](https://docs.litellm.ai/docs/providers/mongodb_vector_stores.md) - [AWS S3 Vectors](https://docs.litellm.ai/docs/providers/s3_vectors.md) - [Valkey - Vector Store](https://docs.litellm.ai/docs/providers/valkey_vector_stores.md) - [RAGFlow Vector Stores](https://docs.litellm.ai/docs/providers/ragflow_vector_store.md) ## Agent Providers - [LangGraph](https://docs.litellm.ai/docs/providers/langgraph.md) - [Pydantic AI Agents](https://docs.litellm.ai/docs/providers/pydantic_ai_agent.md) ## More Providers A-Z - [Abliteration](https://docs.litellm.ai/docs/providers/abliteration.md) - [AI21](https://docs.litellm.ai/docs/providers/ai21.md) - [AI/ML API](https://docs.litellm.ai/docs/providers/aiml.md) - [Aleph Alpha](https://docs.litellm.ai/docs/providers/aleph_alpha.md) - [Amazon Nova](https://docs.litellm.ai/docs/providers/amazon_nova.md) - [Anyscale](https://docs.litellm.ai/docs/providers/anyscale.md) - [Apertis AI (Stima API)](https://docs.litellm.ai/docs/providers/apertis.md) - [AWS Sagemaker](https://docs.litellm.ai/docs/providers/aws_sagemaker.md) - [Baseten](https://docs.litellm.ai/docs/providers/baseten.md) - [Black Forest Labs Image Generation](https://docs.litellm.ai/docs/providers/black_forest_labs.md) - [Black Forest Labs Image Editing](https://docs.litellm.ai/docs/providers/black_forest_labs_img_edit.md) - [Bytez](https://docs.litellm.ai/docs/providers/bytez.md) - [Cerebras](https://docs.litellm.ai/docs/providers/cerebras.md) - [ChatGPT Subscription](https://docs.litellm.ai/docs/providers/chatgpt.md) - [Chutes](https://docs.litellm.ai/docs/providers/chutes.md) - [Clarifai](https://docs.litellm.ai/docs/providers/clarifai.md) - [Cloudflare Workers AI](https://docs.litellm.ai/docs/providers/cloudflare_workers.md) - [Codestral API [Mistral AI]](https://docs.litellm.ai/docs/providers/codestral.md) - [Cognition](https://docs.litellm.ai/docs/providers/cognition.md) - [Cohere](https://docs.litellm.ai/docs/providers/cohere.md) - [CompactifAI](https://docs.litellm.ai/docs/providers/compactifai.md) - [CoralBricks](https://docs.litellm.ai/docs/providers/coralbricks.md) - [Crusoe](https://docs.litellm.ai/docs/providers/crusoe.md) - [Dashscope API (Qwen models)](https://docs.litellm.ai/docs/providers/dashscope.md) - [Databricks](https://docs.litellm.ai/docs/providers/databricks.md) - [DataRobot](https://docs.litellm.ai/docs/providers/datarobot.md) - [Deepgram](https://docs.litellm.ai/docs/providers/deepgram.md) - [DeepInfra](https://docs.litellm.ai/docs/providers/deepinfra.md) - [Eden AI](https://docs.litellm.ai/docs/providers/edenai.md) - [ElevenLabs](https://docs.litellm.ai/docs/providers/elevenlabs.md) - [EmpirioLabs AI](https://docs.litellm.ai/docs/providers/empiriolabs.md) - [Fal AI](https://docs.litellm.ai/docs/providers/fal_ai.md) - [Featherless AI](https://docs.litellm.ai/docs/providers/featherless_ai.md) - [Fireworks AI](https://docs.litellm.ai/docs/providers/fireworks_ai.md) - [FriendliAI](https://docs.litellm.ai/docs/providers/friendliai.md) - [Galadriel](https://docs.litellm.ai/docs/providers/galadriel.md) - [Github](https://docs.litellm.ai/docs/providers/github.md) - [GitHub Copilot](https://docs.litellm.ai/docs/providers/github_copilot.md) - [GMI Cloud](https://docs.litellm.ai/docs/providers/gmi.md) - [GradientAI](https://docs.litellm.ai/docs/providers/gradient_ai.md) - [Heroku](https://docs.litellm.ai/docs/providers/heroku.md) - [HuggingFace](https://docs.litellm.ai/docs/providers/huggingface.md) - [Hyperbolic](https://docs.litellm.ai/docs/providers/hyperbolic.md) - [Inception](https://docs.litellm.ai/docs/providers/inception.md) - [Inference APIs](https://docs.litellm.ai/docs/providers/inferenceapis.md) - [Jina AI](https://docs.litellm.ai/docs/providers/jina_ai.md) - [Lambda AI](https://docs.litellm.ai/docs/providers/lambda_ai.md) - [LlamaGate](https://docs.litellm.ai/docs/providers/llamagate.md) - [Manus](https://docs.litellm.ai/docs/providers/manus.md) - [Meta Model API](https://docs.litellm.ai/docs/providers/meta.md) - [Meta Llama](https://docs.litellm.ai/docs/providers/meta_llama.md) - [Microsoft 365 Copilot](https://docs.litellm.ai/docs/providers/microsoft_365_copilot.md) - [MiniMax](https://docs.litellm.ai/docs/providers/minimax.md) - [Moonshot AI](https://docs.litellm.ai/docs/providers/moonshot.md) - [Morph](https://docs.litellm.ai/docs/providers/morph.md) - [Nadir](https://docs.litellm.ai/docs/providers/nadir.md) - [NanoGPT](https://docs.litellm.ai/docs/providers/nano-gpt.md) - [Nebius AI Studio](https://docs.litellm.ai/docs/providers/nebius.md) - [Neosantara](https://docs.litellm.ai/docs/providers/neosantara.md) - [NLP Cloud](https://docs.litellm.ai/docs/providers/nlp_cloud.md) - [Novita AI](https://docs.litellm.ai/docs/providers/novita.md) - [Nscale (EU Sovereign)](https://docs.litellm.ai/docs/providers/nscale.md) - [Nvidia Riva (Speech-to-Text)](https://docs.litellm.ai/docs/providers/nvidia_riva.md) - [Oracle Cloud Infrastructure (OCI)](https://docs.litellm.ai/docs/providers/oci.md) - [OpenInfer](https://docs.litellm.ai/docs/providers/openinfer.md) - [OVHCloud AI Endpoints](https://docs.litellm.ai/docs/providers/ovhcloud.md) - [Perplexity AI](https://docs.litellm.ai/docs/providers/perplexity.md) - [Predibase](https://docs.litellm.ai/docs/providers/predibase.md) - [Prism](https://docs.litellm.ai/docs/providers/prism.md) - [PublicAI](https://docs.litellm.ai/docs/providers/publicai.md) - [QwenCloud and Qianwen AI Platform (Qwen models)](https://docs.litellm.ai/docs/providers/qwencloud.md) - [RAGFlow](https://docs.litellm.ai/docs/providers/ragflow.md) - [Recraft](https://docs.litellm.ai/docs/providers/recraft.md) - [Refuseless](https://docs.litellm.ai/docs/providers/refuseless.md) - [Reka](https://docs.litellm.ai/docs/providers/reka.md) - [Replicate](https://docs.litellm.ai/docs/providers/replicate.md) - [RunwayML](https://docs.litellm.ai/docs/providers/runwayml/images.md) - [SambaNova](https://docs.litellm.ai/docs/providers/sambanova.md) - [SAP Generative AI Hub](https://docs.litellm.ai/docs/providers/sap.md) - [Sarvam.ai](https://docs.litellm.ai/docs/providers/sarvam.md) - [ScaleDown](https://docs.litellm.ai/docs/providers/scaledown.md) - [Scaleway](https://docs.litellm.ai/docs/providers/scaleway.md) - [SCX.ai](https://docs.litellm.ai/docs/providers/scx_ai.md) - [Snowflake Cortex](https://docs.litellm.ai/docs/providers/snowflake.md) - [Stability AI](https://docs.litellm.ai/docs/providers/stability.md) - [Strands Decider](https://docs.litellm.ai/docs/providers/strands_decider.md) - [Synthetic](https://docs.litellm.ai/docs/providers/synthetic.md) - [Tencent TokenHub](https://docs.litellm.ai/docs/providers/tencent.md) - [Tensormesh](https://docs.litellm.ai/docs/providers/tensormesh.md) - [Together AI](https://docs.litellm.ai/docs/providers/togetherai.md) - [Topaz](https://docs.litellm.ai/docs/providers/topaz.md) - [v0](https://docs.litellm.ai/docs/providers/v0.md) - [Volcano Engine (Volcengine)](https://docs.litellm.ai/docs/providers/volcano.md) - [VoyageAI by MongoDB](https://docs.litellm.ai/docs/providers/voyage.md) - [Weights & Biases Inference](https://docs.litellm.ai/docs/providers/wandb_inference.md) - [WatsonX](https://docs.litellm.ai/docs/providers/watsonx/index.md) - [Xiaomi MiMo](https://docs.litellm.ai/docs/providers/xiaomi_mimo.md) - [Z.AI (Zhipu AI)](https://docs.litellm.ai/docs/providers/zai.md) - [ZeroGPU](https://docs.litellm.ai/docs/providers/zerogpu.md) ## Guides - [Calling Finetuned Models](https://docs.litellm.ai/docs/guides/finetuned_models.md) - [Integrate as a Model Provider](https://docs.litellm.ai/docs/provider_registration/index.md) - [Add OpenAI-Compatible Provider (JSON)](https://docs.litellm.ai/docs/contributing/adding_openai_compatible_providers.md) - [Add Model Pricing & Context Window](https://docs.litellm.ai/docs/provider_registration/add_model_pricing.md) ## Related pages - [OpenAI](https://docs.litellm.ai/docs/providers/openai.md)