Learn LiteLLM
LiteLLM gives you one OpenAI-compatible interface for 100+ LLM providers. Start with the path that matches your setup.
Start Here
Pick one path first.
🐍
SDK Quickstart
Use LiteLLM directly in application code.
- Install
- First request
- Next SDK features
🖥️
Gateway Quickstart
Run LiteLLM as a shared gateway.
- Start proxy
- Add models and keys
- Connect clients
Common Tasks
Jump to a specific task.
⚡
Stream Responses
Return tokens as they are generated.
🧰
Use Tools
Add function calling to your app.
🔀
Add Routing
Retries, fallbacks, and load balancing.
🔑
Set Up Keys
Gateway auth, virtual keys, and access control.
📈
Add Logging
Capture request logs and spend data.
🌐
Choose A Provider
Find provider-specific auth and params.
Docs Map
Use these when you already know the type of doc you want.
Not sure where to start? Use SDK Quickstart for app code or Gateway Quickstart for shared infrastructure.