v1.85.6 - Database Resilience Backport
Deploy this version​
- Docker
- Pip
docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
docker.litellm.ai/berriai/litellm:1.85.6
pip install litellm==1.85.6
v1.85.6 is a patch release on top of v1.85.5. It backports the database-resilience set (Prisma reconnection, prepared-statement and timeout controls, 5xx on DB infra errors during auth) along with passthrough logging and costing fixes, a routing correction, and a dependency bump.
What's Changed​
- fix(router): use forwarded model_id for native Azure container IDs - PR #27921
- fix(proxy): expose Prisma idle/connect timeout and extra DB URL params - PR #28395
- fix(proxy): recover from cached-plan errors by reconnecting the Prisma client - PR #29983
- feat(proxy): add option to disable server-side prepared statements for DB lookups - PR #29984
- fix(proxy): return 5xx on DB infra errors during auth - PR #29986
- fix(passthrough): resolve costing model when body model is unknown - PR #30160
- fix(passthrough): skip
[DONE]sentinels and non-JSON SSE frames in Anthropic streaming logging - PR #30404 - fix(proxy): return deprecated-key lookup result directly in get_data combined view - PR #30327
- chore(deps): bump vitest, brace-expansion, pypdf and tornado - PR #30220
Full Changelog​
https://github.com/BerriAI/litellm/compare/v1.85.5...v1.85.6