LiteLLM is moving to Rust Read the latest updates.
1.105.0rc2 - Dependency refresh and pgbouncer 1.26.0
Deploy this version
- Docker
- Pip
docker run \
-e LITELLM_MASTER_KEY=sk-<paste-a-long-random-key> \
-e DATABASE_URL=postgresql://<user>:<password>@<host>:5432/<dbname> \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
docker.litellm.ai/berriai/litellm:1.105.0-rc.2
pip install litellm==1.105.0rc2
The published GitHub tag is v1.105.0-rc.2. These notes compare it with v1.105.0-rc.1, the previous release candidate on rc/1.105.0. It only refreshes locked dependencies and fixes the Docker build, so there are no feature or API changes and no new database migrations. The v1.105.0-rc.2 tag points at 9d3d673
Performance / Loadbalancing / Reliability improvements
Docker images
- Bump pgbouncer to 1.26.0 so the images build against OpenSSL 4. pgbouncer 1.25.2 no longer compiled, which failed the database, non-root and gateway images - PR #45013
Dependency updates
- Refresh locked dependencies to the versions
mainalready uses: langgraph-sdk 0.4.4, mako 1.4.2, multidict 6.9.1 and werkzeug 3.1.9 inuv.lock, plus source-map-js 1.2.2 and smol-toml 1.9.0 in the dashboard and VS Code extension lockfiles - PR #44803
Full Changelog
https://github.com/BerriAI/litellm/compare/v1.105.0-rc.1...v1.105.0-rc.2