LiteLLM is moving to Rust Read the latest updates.
v1.103.5 - Responses API Tool Call Fixes
Deploy this version
- Docker
- Pip
docker run \
-e LITELLM_MASTER_KEY=sk-<paste-a-long-random-key> \
-e DATABASE_URL=postgresql://<user>:<password>@<host>:5432/<dbname> \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
docker.litellm.ai/berriai/litellm:1.103.5
pip install litellm==1.103.5
This release is published as ghcr.io/berriai/litellm:v1.103.5. See the GitHub release and the full releases page
v1.103.5 is a patch release on top of v1.103.4. It fixes how LiteLLM turns a Responses API reply back into a chat completion, which affects /chat/completions calls with tools on GPT-5.4 and newer and on responses/ deployments. The v1.103.5 tag points at dec1691
What's Changed
- Tool calls no longer land on a separate
choices[1], so agents that only readchoices[0]run them again - PR #46099 - Multiple tool calls in one non-streaming reply now get their own
indexinstead of all being 0 - PR #46109
Both fixes are backported in PR #46949
Full Changelog
https://github.com/BerriAI/litellm/compare/v1.103.4...v1.103.5