LiteLLM is moving to Rust Read the latest updates.
LiteLLM v1.108.9 (LTS) adds Vertex labels and fixes Foundry /openai/v1
tip
v1.108.9 is a patch release on the 1.108 LTS line. The lts image tag always points to the latest LTS release, so pull docker.litellm.ai/berriai/litellm:lts to stay on the newest LTS patch. See the LTS pilot.
Deploy this version​
- Docker
- Pip
docker run \
-e LITELLM_MASTER_KEY=sk-<paste-a-long-random-key> \
-e DATABASE_URL=postgresql://<user>:<password>@<host>:5432/<dbname> \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
docker.litellm.ai/berriai/litellm:1.108.9
pip install litellm==1.108.9
This release is published as ghcr.io/berriai/litellm:v1.108.9. See the GitHub release and the full releases page.
v1.108.9 is a patch release on top of v1.108.8. There are no new database migrations. The v1.108.9 tag points at 82ae95f.
What's Changed​
- Azure: Fixed Kimi K3 on Azure AI Foundry losing its earlier reasoning after tool calls and refusing
reasoning_effort- PR #51747 - Azure: Fixed 400 on Foundry project
/openai/v1bases and 404 on resource-level/openai/v1Responses bases - PR #51767 - AWS Bedrock: Fixed 500 on
s3://image, PDF and video URLs on Converse models, which now go to Bedrock as S3 sources - PR #50577 - AWS Bedrock: Fixed AWS 400 on Bedrock vector store search with OpenAI-style filters - PR #51291
- Vertex AI and Gemini: Added
vertex_request_label_fieldsto label Vertex calls with the caller's key, team, org and project - PR #50732 - Vertex AI and Gemini: Fixed 400
Extra inputs are not permittedwhen sendinglabelsto Claude on Vertex AI - PR #48753 - Other providers: Added Vercel AI Gateway models on
/v1/decisions, billed at the cost Vercel reports - PR #50642 - Responses API: Fixed streamed
/v1/responsesdropping the first answer fragment when it arrives together with reasoning - PR #51356 - Responses API: Fixed
cache_controlmarks being dropped on chat requests with function tools bridged to the Responses API - PR #51783 - Deployment: Changed the Docker images to a newer Wolfi base and updated opentelemetry, dnspython, tornado and soupsieve - PR #51853
The changes are backported in PR #50401, PR #51250, PR #51292, PR #51748, PR #51769, PR #51786 and PR #51796.
Full Changelog​
https://github.com/BerriAI/litellm/compare/v1.108.8...v1.108.9