LiteLLM is moving to Rust Read the latest updates.
LiteLLM v1.106.5, v1.105.6, v1.104.8 and v1.103.10 trim failure logs for rejected requests
Deploy this version
- Docker
- Pip
docker run \
-e LITELLM_MASTER_KEY=sk-<paste-a-long-random-key> \
-e DATABASE_URL=postgresql://<user>:<password>@<host>:5432/<dbname> \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
docker.litellm.ai/berriai/litellm:1.104.8
pip install litellm==1.104.8
This release is published as ghcr.io/berriai/litellm:v1.104.8. See the GitHub release and the full releases page
v1.104.8 is a patch release on top of v1.104.7. It changes what failure logs for rejected requests carry and how the GCS logger picks its bucket on stable/1.104.x. There are no new database migrations. The v1.104.8 tag points at b78a634
What's Changed
- Failure logs for rejected requests keep only core request fields,
tagsand guardrail details - PR #48599 - The GCS logger uses the bucket and credentials configured on the proxy - PR #48599
The change and the version bump are backported in PR #48603
Full Changelog
https://github.com/BerriAI/litellm/compare/v1.104.7...v1.104.8