LiteLLM is moving to Rust Read the latest updates.
LiteLLM v1.108.5 (LTS) fixes workload identity on OpenAI routes and transcription cost
tip
v1.108.5 is a patch release on the 1.108 LTS line. The lts image tag always points to the latest LTS release, so pull docker.litellm.ai/berriai/litellm:lts to stay on the newest LTS patch. See the LTS pilot.
Deploy this version
- Docker
- Pip
docker run \
-e LITELLM_MASTER_KEY=sk-<paste-a-long-random-key> \
-e DATABASE_URL=postgresql://<user>:<password>@<host>:5432/<dbname> \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
docker.litellm.ai/berriai/litellm:1.108.5
pip install litellm==1.108.5
This release is published as ghcr.io/berriai/litellm:v1.108.5. See the GitHub release and the full releases page.
v1.108.5 is a patch release on top of v1.108.4. There are no new database migrations. The v1.108.5 tag points at 2a61f21.
What's Changed
- OpenAI: Fixed keyless workload identity deployments answering 401 on image edits, audio, files, batches and other routes - PR #50962
- Other providers: Fixed
ollama_chat/streams giving every parallel tool call index 0, so clients ran only the first call - PR #50718 - Messages API: Fixed
/v1/messagesanswering 400 for a param listed in the deployment'sadditional_drop_params- PR #50755 - Cost tracking and pricing: Fixed incorrect transcription cost for some FLAC files, which could push a key over its budget - PR #50860
Full Changelog
https://github.com/BerriAI/litellm/compare/v1.108.4...v1.108.5
