Skip to main content

Decisions API is here. Call Jev, Clef or any decision model through one /v1/decisions endpoint. →

Docs

HomeGet started with LiteLLM

AI GatewayRoute and control LLM traffic Auto RouterBest model for each request Claude, Codex & CopilotUse your existing subscriptions Logging & ObservabilityLogs, spend, and callbacks MCP GatewayGive agents governed access to tools Agent GatewayRegister and invoke A2A agents Python SDKCall 100+ LLMs with one interface Model CatalogPricing and context windows

Docs AI Providers Integrations Enterprise Learn Changelog Blog Rust

Get started
Quickstart
Agent resources
Products
LiteLLM Gateway
AI Gateway
MCP Gateway
Agent Gateway
Auto Router
Python SDK
LiteLLM Lens
Features
Overview
Claude, Codex & Copilot subscriptions
Routing & Reliability
Requests & Responses
Tool Calling
Multimodal
Prompts & Context
Compatibility
Developer Tools
liteagents SDK
lite CLI
Self-Hosted Coding Agents
Reference
Supported Endpoints
Providers
More
Troubleshooting
Resources

Prompts & Context

Prompts & Context

Prompt caching, assistant prefill, and predicted outputs.

Prompt Caching

Supported Providers:

Assistant Prefill

Supported by:

Predicted Outputs

| Property | Details |

Image Generation in Chat

One API for every model, in your code or behind your own gateway.

Get the latest LiteLLM updates

New model support, product launches, and release notes, in your inbox.

Product

Gateway quickstart
Python SDK
Production deployment
MCP Gateway
Agent Gateway
Rust AI Gateway (beta)
Enterprise

Resources

Blog
Changelog
Agent resources
llms.txt
Trust Center

Community

GitHub
Discord
Slack
YouTube
X
LinkedIn

Company

litellm.ai
Talk to sales
Careers

© 2026 LiteLLM

SOC 2 Type II MIT license