LiteLLM is moving to Rust Read the latest updates.
LiteLLM v1.108.7 (LTS) adds Gemini batches and Bedrock image search
tip
v1.108.7 is a patch release on the 1.108 LTS line. The lts image tag always points to the latest LTS release, so pull docker.litellm.ai/berriai/litellm:lts to stay on the newest LTS patch. See the LTS pilot.
Deploy this version​
- Docker
- Pip
docker run \
-e LITELLM_MASTER_KEY=sk-<paste-a-long-random-key> \
-e DATABASE_URL=postgresql://<user>:<password>@<host>:5432/<dbname> \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
docker.litellm.ai/berriai/litellm:1.108.7
pip install litellm==1.108.7
This release is published as ghcr.io/berriai/litellm:v1.108.7. See the GitHub release and the full releases page.
v1.108.7 is a patch release on top of v1.108.6. There are no new database migrations. The v1.108.7 tag points at 1b769ce.
Breaking Changes
What's Changed​
- Azure: Added gpt-image edits on Azure AI Foundry deployments, including deployments under a custom name - PR #49650
- AWS Bedrock: Added image search on Bedrock knowledge bases with
query_image, including image hits in the results - PR #51062 - Vertex AI and Gemini: Fixed Gemini image calls billing text, thinking and Vertex Priority tokens at the wrong rates - PR #51017
- Vertex AI and Gemini: Fixed
/geminibatchGenerateContentbatches logging $0 with modelunknowninstead of billing the calling key - PR #51279 - Other providers: Fixed
reasoning_effortbeing dropped or rejected for Baseten models - PR #40152, also inv1.109.0 - Other providers: Fixed
baseten/*listing retired deployment IDs instead of the current Baseten Model APIs - PR #46945, also inv1.109.0 - Responses API: Fixed missing or repeated
sequence_numberon bridged/v1/responsesstreaming events - PR #44944 - Responses API: Fixed streamed MCP follow-ups keeping only the latest tool round, so models repeated tool calls - PR #47698, also in
v1.109.0 - Responses API: Fixed 400 on Bedrock when a
previous_response_idchain contains a failed turn - PR #48647, also inv1.109.0 - Responses API: Changed Responses-only fields such as
max_tool_callsto answer 400 on bridged providers unlessdrop_paramsis on - PR #48655, also inv1.109.0 - Batches and files: Added Gemini batches on
/v1/batches, with output download through/v1/filesand spend tracking - PR #51032 - Routing and fallbacks: Fixed Decisions calls on a mixed model group hitting a Bedrock deployment and answering 400 - PR #48175, also in
v1.109.0
The changes are backported in PR #51262, PR #51266, PR #51271 and PR #51340.
Full Changelog​
https://github.com/BerriAI/litellm/compare/v1.108.6...v1.108.7