Skip to main content
LiteLLM is moving to Rust Read the latest updates.

Changelog

The main changes in each LiteLLM release. Open a release for its full notes, upgrade steps and every merged PR. Watch BerriAI/litellm on GitHub to hear about new releases.

LiteLLM v1.106.2, v1.105.3 and v1.103.7 fix spend on failed requests and batch cost

  • Requests that time out after reaching the provider, client cancellations and each billed retry attempt are priced on their prompt instead of logging $0.
  • Completed batches keep their spend through malformed results and temporary accounting failures, and Bedrock inference profiles are priced.
  • Azure gpt-6-astra with reasoning_effort: none and gpt-5.3-codex with minimal now return 400 unless drop_params is on.
  • v1.105.3 also lists per-user auth MCP tools in the catalog again.
Read the release notes →

LiteLLM v1.106.1 fixes count_tokens, MCP tool calls and thinking blocks

  • Bare MCP tool names on a single-server scope now go to that server, so a cold replica no longer returns Tool not found.
  • Vector stores created through the proxy send only the caller's metadata to the provider, so later metadata updates no longer fail with 400.
  • Token count responses carry litellm_count_source, and Anthropic-format count requests for OpenAI and Gemini models match how /v1/messages converts them.
Read the release notes →

LiteLLM v1.106.0 adds Claude Haiku 5.5, a Rust Lens service and MCP rate limits

  • Claude Haiku 5.5 works on day one across Anthropic, Bedrock, Bedrock Mantle, Vertex AI, Azure AI and Perplexity.
  • Lens runs as a standalone Rust service, and agents upload traces to it directly with dedicated keys.
  • MCP Gateway rate limits now cover every MCP operation, and a new server-level rpm caps all callers of one server.
  • The caller's LiteLLM key is never forwarded to MCP servers, so each upstream server needs its own static header or OAuth credential.
Read the release notes →

LiteLLM v1.105.0 adds Claude Sonnet 5.5, the Decisions API and litellm.agent()

  • Claude Sonnet 5.5 works on day one across Anthropic, Bedrock, Bedrock Mantle, Vertex AI, Azure AI, OpenRouter and Perplexity.
  • /v1/decisions and /v1/systemone let decision models answer yes/no, choice and score questions across OpenAI, Perplexity, TypeSafe, OpenRouter and Cloudflare.
  • litellm.agent() runs Claude Code, Codex, OpenCode and Deep Agents through the AI gateway from the SDK.
  • Bedrock GPT-5.6, GPT-6 and GPT-6.1 use native Chat Completions, which changes response ids and reasoning fields, so use bedrock/converse/<model> to stay on Converse.
Read the release notes →

Older releases are listed in the sidebar.