Streaming
| Feature | LiteLLM SDK | LiteLLM Proxy |
Batching
LiteLLM allows you to:
Structured Outputs
Quick Start
Reasoning
Requires LiteLLM v1.63.0+
Requests & Responses
Streaming, batching, structured outputs, and reasoning.
Streaming, batching, structured outputs, and reasoning.
| Feature | LiteLLM SDK | LiteLLM Proxy |
LiteLLM allows you to:
Quick Start
Requires LiteLLM v1.63.0+