LiteLLM is moving to Rust Read the latest updates.
LiteLLM v1.110.1, v1.111.0rc2 and v1.106.11 fix GPT-6.2 prompt caching
Released
Deploy this version​
- Docker
- Pip
docker run \
-e LITELLM_MASTER_KEY=sk-<paste-a-long-random-key> \
-e DATABASE_URL=postgresql://<user>:<password>@<host>:5432/<dbname> \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
docker.litellm.ai/berriai/litellm:1.110.1
pip install litellm==1.110.1
This release is published as ghcr.io/berriai/litellm:v1.110.1. See the GitHub release and the full releases page.
v1.110.1 is a patch release on top of v1.110.0. There are no new database migrations. The v1.110.1 tag points at 47b394b.
Breaking Changes
- Deployment: Switch exec probes on the UI image from
curltowget, since that image no longer shipscurl- PR #52298
What's Changed​
- OpenAI: Fixed GPT-6.2 prompt caching for system prompts sent to
/v1/chat/completionsor/v1/messageswithstore: false- PR #52599 and PR #52694 - Deployment: Changed the UI image to slim nginx, which drops
curlbut keepswgetandnc- PR #52298 - Deployment: Changed the Docker images to a newer Wolfi base image - PR #52749
The changes are backported in PR #52595 and PR #52658.
Full Changelog​
https://github.com/BerriAI/litellm/compare/v1.110.0...v1.110.1