LiteLLM is moving to Rust Read the latest updates.
LiteLLM v1.106.4, v1.105.5, v1.104.7 and v1.103.9 refresh image base layers
Deploy this version
- Docker
- Pip
docker run \
-e LITELLM_MASTER_KEY=sk-<paste-a-long-random-key> \
-e DATABASE_URL=postgresql://<user>:<password>@<host>:5432/<dbname> \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
docker.litellm.ai/berriai/litellm:1.104.7
pip install litellm==1.104.7
This release is published as ghcr.io/berriai/litellm:v1.104.7. See the GitHub release and the full releases page
v1.104.7 is a patch release on top of v1.104.6. It fixes a startup crash when the remote model cost map is unreachable and moves the Docker images to newer base images on stable/1.104.x. There are no new database migrations. The v1.104.7 tag points at f2a3d34
What's Changed
- The proxy no longer sometimes exits on startup with an
ImportErrorwhen it cannot reach the remote model cost map. This started inv1.104.0- PR #46711 - Docker images move to newer base images, so image scans stop flagging brotli 1.2.0, the emSign ECC Root CA - G3 and packages from repo lockfiles that the images never install - PR #48280
The startup fix and the version bump are backported in PR #48293
Full Changelog
https://github.com/BerriAI/litellm/compare/v1.104.6...v1.104.7