Skip to main content
LiteLLM is moving to Rust Read the latest updates.

LiteLLM v1.108.9 (LTS) adds Vertex labels and fixes Foundry /openai/v1

tip

v1.108.9 is a patch release on the 1.108 LTS line. The lts image tag always points to the latest LTS release, so pull docker.litellm.ai/berriai/litellm:lts to stay on the newest LTS patch. See the LTS pilot.

Deploy this version​

docker run \
-e LITELLM_MASTER_KEY=sk-<paste-a-long-random-key> \
-e DATABASE_URL=postgresql://<user>:<password>@<host>:5432/<dbname> \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
docker.litellm.ai/berriai/litellm:1.108.9

This release is published as ghcr.io/berriai/litellm:v1.108.9. See the GitHub release and the full releases page.

v1.108.9 is a patch release on top of v1.108.8. There are no new database migrations. The v1.108.9 tag points at 82ae95f.

What's Changed​

  • Azure: Fixed Kimi K3 on Azure AI Foundry losing its earlier reasoning after tool calls and refusing reasoning_effort - PR #51747
  • Azure: Fixed 400 on Foundry project /openai/v1 bases and 404 on resource-level /openai/v1 Responses bases - PR #51767
  • AWS Bedrock: Fixed 500 on s3:// image, PDF and video URLs on Converse models, which now go to Bedrock as S3 sources - PR #50577
  • AWS Bedrock: Fixed AWS 400 on Bedrock vector store search with OpenAI-style filters - PR #51291
  • Vertex AI and Gemini: Added vertex_request_label_fields to label Vertex calls with the caller's key, team, org and project - PR #50732
  • Vertex AI and Gemini: Fixed 400 Extra inputs are not permitted when sending labels to Claude on Vertex AI - PR #48753
  • Other providers: Added Vercel AI Gateway models on /v1/decisions, billed at the cost Vercel reports - PR #50642
  • Responses API: Fixed streamed /v1/responses dropping the first answer fragment when it arrives together with reasoning - PR #51356
  • Responses API: Fixed cache_control marks being dropped on chat requests with function tools bridged to the Responses API - PR #51783
  • Deployment: Changed the Docker images to a newer Wolfi base and updated opentelemetry, dnspython, tornado and soupsieve - PR #51853

The changes are backported in PR #50401, PR #51250, PR #51292, PR #51748, PR #51769, PR #51786 and PR #51796.

Full Changelog​

https://github.com/BerriAI/litellm/compare/v1.108.8...v1.108.9

LiteLLM Enterprise
SSO/SAML, audit logs, spend tracking, multi-team management, and guardrails, built for production.
Learn more →