Skip to main content

🚅 LiteLLM

Docs Learn Integrations Enterprise Changelog Blog Auto Router [Add-on]

All Posts

2026

TypeSafe Jev on LiteLLM
Day 0 Support: Qwen3.8-Omni-Flash
Reduce agent context with TypeSafe Jev and LiteLLM
Auto Router: 5 Improvements for Cost, Speed, and Team Control
September Townhall: Product + Roadmap Updates
Auto Router: Maximize Quality & Savings with Our Fuse LLM Classifier
OCR uses Rust by default starting with v1.102.0-rc.1
Incident Report: Retry Breadcrumb Memory Growth Causing OOM on v1.100.0
Auto Router: 45% Lower Cost on 25 SWE-bench Tasks
How Pfizer Improved LiteLLM Gateway Performance and Resiliency at Scale
Auto-Router Updates: Harness-Aware Routing
Secure shared AI agents with identity-aware access and spend controls
AutoRouter: Tune Heuristics for Your Traffic
Our Updated SOC 2 Type 2 Report Is Available
Subtask-Specific Routing: Same Quality, 46% Less Cost
AutoRouter Per-Hop Compression: Cut LLM Classifier Costs Another 32%
Auto-Router: Escalate a Task That Gets Stuck
Day 0 Support: GPT-6 Astra
Day 0 support: Meta Muse Spark 1.3
Day 0 support: Gemini 3.8 Flash
Introducing AutoRouter Heuristic v2: 27% More Tasks Solved at 45% Lower Cost
Introducing LiteLLM Fusion: 56% More Tasks Solved Than Fable 5
Auto-Router: Route on Context Size and Modality
Day 0 Support: Claude Fable 5.1
August Townhall Updates: Security, Stability, and Product
Shadow Evaluations: Test the Auto-Router on Your Own Production Traffic
Day 0 support: Gemini 3.7 Flash
August Townhall: Product + Roadmap Updates
51% Cost Savings Reported From a Live Production Deployment
Auto Router: Opus level quality at up to 27% lower cost
AutoRouter: Easy Visibility to Your Savings
AutoRouter: 1 Click Deploy
Auto Router v1.97: usage benchmarks and better quality for lower cost
Prompt Caching Works with Auto Router
Cut 75% Claude Code cost with near frontier model quality
July Townhall Updates: 38 Security Fixes, 317 Bug Fixes, and Autorouter V2
Day 0 Support: Claude Opus 5
Benchmarking the LiteLLM Rust AI Gateway: Overhead, Memory, and Cost
Announcing Router Plugins: Customize Routing Signals
Auto Router v2: one router for complexity, semantic, and adaptive routing
Incident Report: Prompt Cache Invalidation for Claude Code on Bedrock Invoke
July stability update: hardening MCP auth and cutting pass-through memory
July Townhall: Product + Roadmap Updates
Day 0 Support: GPT-5.6 (Sol, Terra, Luna)
5 ways to cut Claude Code costs with LiteLLM
Day 0 Support: Claude Sonnet 5
LiteLLM × Headroom: Use 60-95% fewer tokens with Claude Code
June Townhall Updates: 94 Bug Fixes, OCR + Realtime are in Rust, and a Zero-Regression Commitment
Swap OpenAI Code Interpreter for E2B/OpenSandbox
Migrating LiteLLM to Rust - Building the Fastest and Litest AI Gateway
LiteLLM version support: focusing on the four most recent stable lines
Semantic Caching on Valkey and AWS ElastiCache
June Townhall: Product + Roadmap Updates
June Stability Update: We're Making Stability a First-Class Citizen at LiteLLM
Day 0 Support: Claude Fable 5
A Unified Agent Control Plane
Announcing LiteLLM x Microsoft ASSERT
LiteLLM Labs: Announcing Lite-Harness SDK — Unified API for Claude Code, Codex, and Pi AI
Fixed in 1.84.0+ - Version Update: Authentication Bypass via Host Header Injection (GHSA-4xpc-pv4p-pm3w)
Day 0 Support: Claude Opus 4.8
How we built a background agent to cover 30% of our backlog
May Townhall Updates: Security Hardening, Release Versioning, and the Agent Platform
DAY 0 Support: Gemini 3.5 Flash on LiteLLM
Google AI Studio Managed Agents on LiteLLM
May Townhall: Product + Roadmap Updates
Announcing Componentized Deployments
Security Update: Mistral AI PyPI Supply Chain Attack — LiteLLM Not Impacted
LiteLLM Managed Agents Platform — Alpha Now Open for Public Preview
Security Update: CVE-2026-42208 in LiteLLM Proxy
Incident Report: Prisma DB Reconnect Blocks the Event Loop and Kills Liveliness
LiteLLM release versioning is changing: standard names, MINOR for weekly, PATCH for hotfixes
Gemini Embedding 2 (GA): Multimodal Embeddings on LiteLLM
Day 0 Support: GPT-5.5 and GPT-5.5 Pro
Security Update: CVE-2026-30623 — Command Injection via Anthropic's MCP SDK
LiteLLM × Akto: Model-Based Detection Alongside Built-in Guardrails
Day 0 Support: Claude Opus 4.7
Making the AI Gateway Resilient to Redis Failures
April Townhall Updates: CI/CD v2, Stability, and Product Roadmap
Security Update: Vulnerability Disclosures and Ongoing Hardening
April Townhall: Security + Product Roadmap
Announcing CI/CD v2 for LiteLLM
LiteLLM + Vanta: SOC 2 Type 2 and ISO 27001 Recertification
Security Townhall Updates
Security Update: Suspected Supply Chain Incident
Incident Report: Guardrail logging exposed secret headers in spend logs and traces
Day 0 Support: GPT-5.4-mini and GPT-5.4-nano
New Video Characters, Edit and Extension API support
Realtime WebRTC HTTP Endpoints
Day 0 Support: GPT-5.4
DAY 0 Support: Gemini 3.1 Flash Lite Preview on LiteLLM
Incident Report: Cache Eviction Closes In-Use httpx Clients
Day 0 Support: GPT-5.3-Codex
Incident Report: Encrypted Content Failures in Multi-Region Responses API Load Balancing
Incident Report: Wildcard Blocking New Models After Cost Map Reload
Incident Report: SERVER_ROOT_PATH regression broke UI routing
DAY 0 Support: Gemini 3.1 Pro on LiteLLM
Incident Report: vLLM Embeddings Broken by encoding_format Parameter
Day 0 Support: Claude Sonnet 4.6
Incident Report: Invalid beta headers with Claude Code
Day 0 Support: MiniMax-M2.5
Incident Report: Invalid model cost map on main
Your Middleware Could Be a Bottleneck
Improve release stability with 24 hour load tests
Day 0 Support: Claude Opus 4.6
Achieving Sub-Millisecond Proxy Overhead

2025

DAY 0 Support: Gemini 3 Flash on LiteLLM
Day 0 Support: Claude 4.5 Opus (+Advanced Features)
DAY 0 Support: Gemini 3 on LiteLLM
Gemini Embedding 2 Preview: Multimodal Embeddings on LiteLLM

Tags

A

adaptive1
advanced features1
agents8
ai-gateway7
akto1
announcement6
anthropic10
architecture1
auth1
auto-router3

B

bedrock1
benchmarks12
budgets1

C

caching4
case-study1
characters1
ci-cd1
claude9
claude-code3
code interpreter1
codex1
completion5
complexity-router17
compliance2
compression1
context1
cost12
cost-optimization2
customer-story1

D

dashscope1
database1
day 0 support18
docker1

E

e2b1
effort1
elasticache1
embeddings3
engineering22
evals1

F

fable 51
fable 5.11
fastapi1
finops1

G

gemini10
gemini-3.7-flash1
gemini-3.8-flash1
google-ai-studio1
gpt-5.3-codex1
gpt-5.41
gpt-5.4-mini1
gpt-5.4-nano1
gpt-5.51
gpt-5.5-pro1
gpt-5.61
gpt-5.6-luna1
gpt-5.6-sol1
gpt-5.6-terra1
gpt-61
gpt-6-astra1
guardrails4

H

harnesses1
headroom2

I

ideas1
incident-report14
infrastructure1
interactions1

J

jev1

K

kubernetes1

L

lap1
lite-harness1
litellm1
litellm-labs1
llm1
llms8
load-balancing1

M

M2.51
managed-agents1
mcp3
memory1
meta1
middleware1
minimax1
mistral1
model-access1
multimodal2
muse-spark-1.31

O

observability2
ocr1
openai7
opensandbox1
opus 4.61
opus 4.71
opus 4.81
opus 51

P

packaging1
partnership2
performance8
plugins1
prisma1
product16
programmatic tool calling1
prompt-caching1
proxy5

Q

quality1
qwen1
qwen3.8-omni-flash1

R

realtime1
redis3
release2
releases1
reliability10
responses-api1
router1
routing22
rust3

S

sandbox1
scaling1
sdk1
security18
semantic cache1
semantic-router1
sonnet 4.61
sonnet 51
stability5
supernova1
supply-chain1
support1

T

testing2
tool search1
townhall11
typesafe1

U

ui3

V

valkey1
vertex ai2
videos1
vllm1

W

webrtc1

Docs

Getting Started

Community

Discord
Twitter

More

GitHub

Copyright © 2026 liteLLM