LiteLLM is moving to Rust Read the latest updates.
LiteLLM v1.108.15 (LTS) adds ResetData and fixes Cohere v2 chat params
Released
tip
v1.108.15 is a patch release on the 1.108 LTS line. The lts image tag always points to the latest LTS release, so pull docker.litellm.ai/berriai/litellm:lts to stay on the newest LTS patch. See the LTS pilot.
Deploy this version​
- Docker
- Pip
docker run \
-e LITELLM_MASTER_KEY=sk-<paste-a-long-random-key> \
-e DATABASE_URL=postgresql://<user>:<password>@<host>:5432/<dbname> \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
docker.litellm.ai/berriai/litellm:1.108.15
pip install litellm==1.108.15
This release is published as ghcr.io/berriai/litellm:v1.108.15. See the GitHub release and the full releases page.
Breaking Changes
Set api_key or the provider's key env var on keyless JSON-configured deployments, which now get a 401. See PR #50819.
v1.108.15 is a patch release on top of v1.108.14. There are no new database migrations. The v1.108.15 tag points at 43d4823.
What's Changed​
- Other providers: Added the ResetData provider and fixed $0 spend on Groq and Meta transcription - PR #50819
- Other providers: Fixed Cohere v2 streamed tool calls arriving as one empty chunk - PR #47794
- Other providers: Fixed Cohere v2 chat ignoring
tool_choiceand returning 400 forreasoning_effortandjson_schemaresponse_format- PR #50834
The changes are backported in PR #51851 and PR #53314.
Full Changelog​
https://github.com/BerriAI/litellm/compare/v1.108.14...v1.108.15