LiteLLM is moving to Rust 🦀Read the latest updates.›

LiteLLM v1.108.3 (LTS) fixes Bedrock api_base and large MCP tool results

tip

v1.108.3 is a patch release on the 1.108 LTS line. The lts image tag always points to the latest LTS release, so pull docker.litellm.ai/berriai/litellm:lts to stay on the newest LTS patch. See the LTS pilot.

Deploy this version

Docker

docker run \
-e LITELLM_MASTER_KEY=sk-<paste-a-long-random-key> \
-e DATABASE_URL=postgresql://<user>:<password>@<host>:5432/<dbname> \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
docker.litellm.ai/berriai/litellm:1.108.3

Pip

pip install litellm==1.108.3

This release is published as ghcr.io/berriai/litellm:v1.108.3. See the GitHub release and the full releases page.

v1.108.3 is a patch release on top of v1.108.2. There are no new database migrations. The v1.108.3 tag points at b7d579f.

What's Changed

• AWS Bedrock: Fixed every request failing on a Bedrock deployment with api_base: "", which answered 500 or 400 - PR #50449
• MCP: Fixed tool results over 1 MiB failing with SSE stream ended without a response, broken since v1.103.0 - PR #47034
• Guardrails: Fixed model-level post_call guardrails checking each response twice and calling the moderation provider twice - PR #50463

Full Changelog

https://github.com/BerriAI/litellm/compare/v1.108.2...v1.108.3