Skip to main content
LiteLLM is moving to Rust Read the latest updates.

LiteLLM v1.109.3 and v1.106.12 fix GPT-6.2 caching on stored requests

Released

Deploy this version​

docker run \
-e LITELLM_MASTER_KEY=sk-<paste-a-long-random-key> \
-e DATABASE_URL=postgresql://<user>:<password>@<host>:5432/<dbname> \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
docker.litellm.ai/berriai/litellm:1.106.12

This release is published as ghcr.io/berriai/litellm:v1.106.12. See the GitHub release and the full releases page.

v1.106.12 is a patch release on top of v1.106.11. There are no new database migrations. The v1.106.12 tag points at c6dd3dd.

What's Changed​

  • Caching: Fixed GPT-6.2 system prompts missing the prompt cache on /v1/chat/completions and /v1/messages unless store: false - PR #52906
  • Keys, teams and auth: Fixed /key/info letting a key with no user read other userless keys by hash or alias - PR #52838 and PR #52925
  • Deployment: Changed dnspython, tornado, filelock, soupsieve and opentelemetry to newer releases - PR #52936 and PR #53032
  • Deployment: Changed the Docker images to a newer Wolfi base image - PR #53033

The changes are backported in PR #52924 and PR #52936.

Full Changelog​

https://github.com/BerriAI/litellm/compare/v1.106.11...v1.106.12

LiteLLM Enterprise
SSO/SAML, audit logs, spend tracking, multi-team management, and guardrails, built for production.
Learn more →