LiteLLM is moving to Rust Read the latest updates.
LiteLLM v1.104.9 and v1.103.11 speed up request lookups in the Logs view
Deploy this version
- Docker
- Pip
docker run \
-e LITELLM_MASTER_KEY=sk-<paste-a-long-random-key> \
-e DATABASE_URL=postgresql://<user>:<password>@<host>:5432/<dbname> \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
docker.litellm.ai/berriai/litellm:1.103.11
pip install litellm==1.103.11
This release is published as ghcr.io/berriai/litellm:v1.103.11. See the GitHub release and the full releases page.
v1.103.11 is a patch release on top of v1.103.10. There are no new database migrations. The two LiteLLM_SpendLogs index migrations stay no-ops, and the indexes are now built after migrations run. The migration job builds them, and a proxy that runs its own migrations builds them in the background once it serves. The v1.103.11 tag points at 6061a83.
What's Changed
- Logging and observability: Improved request lookups in the Logs view on large spend log tables by building any missing indexes after migrations - PR #43948, PR #44109, PR #44203, PR #46131
- Deployment: Improved startup reliability when several replicas boot against one database at the same time - PR #40932, PR #44283
The changes are backported in PR #50856, and the version bump is in PR #50984.
Full Changelog
https://github.com/BerriAI/litellm/compare/v1.103.10...v1.103.11
