LiteLLM is moving to Rust Read the latest updates.
LiteLLM v1.110.0rc3 fixes fallback overrides and WebSocket model aliases
Deploy this version​
- Docker
- Pip
docker run \
-e LITELLM_MASTER_KEY=sk-<paste-a-long-random-key> \
-e DATABASE_URL=postgresql://<user>:<password>@<host>:5432/<dbname> \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
docker.litellm.ai/berriai/litellm:1.110.0-rc.3
pip install litellm==1.110.0rc3
This release is published as ghcr.io/berriai/litellm:v1.110.0-rc.3. See the GitHub release and the full releases page.
v1.110.0rc3 is the current release candidate for 1.110.0. The published GitHub tag is v1.110.0-rc.3. These notes compare it with v1.110.0-rc.2, the previous release candidate on rc/1.110.0. It is a small rc patch with fixes backported onto the rc branch, and everything else is unchanged from v1.110.0-rc.2, whose release notes cover the previous patch. The v1.110.0rc1 release notes cover the full 1.110 line. There are no new database migrations. The v1.110.0-rc.3 tag points at 3510cb6.
What's Changed​
- Other providers: Fixed Hugging Face chat sending requests to
Noneor crashing when the endpoint comes fromHUGGINGFACE_API_BASE- PR #51449 - Other providers: Fixed unmapped Fireworks AI models sized like
1p5bor0p6bbilling at double the up-to-4B rate - PR #51451 - Other providers: Fixed 500 when streaming OpenCode Go Messages-protocol models through chat completions - PR #51715
- Responses API: Fixed Responses WebSocket requests dropping the team's model alias and landing on another deployment - PR #51380
- Token counting: Fixed follow-up requests with Anthropic server tool history, such as web search, skipping the context-window check - PR #51334
- Routing and fallbacks: Fixed 500 when a request sends a string fallback override such as
"fallbacks": "default", broken since v1.110.0-dev.1 - PR #51502 - Deployment: Changed opentelemetry, dnspython, tornado and soupsieve to the newer versions that main already ships - PR #51854
The changes are backported in PR #51514, PR #51854 and PR #51858.
Full Changelog​
https://github.com/BerriAI/litellm/compare/v1.110.0-rc.2...v1.110.0-rc.3