Cookbook

The Cookbook has step-by-step recipes. Each recipe connects LiteLLM to an external tool, framework, or service, or builds a complete workflow from start to end. To set up LiteLLM first, use the Gateway Quickstart or the SDK Quickstart.

Connect apps and providers

Install the SDK, set provider keys, and call Azure OpenAI, HuggingFace, TogetherAI, and local models.

Control access

Manage users and teams, and connect SSO and SCIM.

Control cost and capacity

Add fallbacks and use prompt caching.

Control content

Add guardrails and PII masking with Aporia and Presidio.

See what happened

Send logs to Elasticsearch, compare models, and run evaluation suites.

Connect tools and agents

Use agent SDKs, coding tools, file search, vector stores, and realtime audio.