Integrations
This section covers integrations with various tools and services that can be used with LiteLLM (either Proxy or SDK).
Observability​
Track, debug, and analyze LLM calls with observability platforms.
Langfuse
LLM observability and analytics.
Datadog
Metrics, traces, and dashboards.
Grafana Cloud
LLM traces, GenAI metrics, and dashboards.
OpenTelemetry
Vendor-neutral tracing.
LangSmith
LLM debugging and evaluation.
Arize / Phoenix
ML observability and evaluation.
Helicone
LLM request logging and analytics.
MLflow
Experiment tracking.
Weights & Biases
ML experiment tracking.
PostHog
Product analytics.
View all observability integrations →
Alerting & Monitoring​
Set up alerts, metrics collection, and infrastructure monitoring.
Prometheus
Metrics collection and monitoring.
PagerDuty
Incident response and alerting.
Alerting
Slack, Teams, and webhook alerts.
Pyroscope
Continuous profiling.
Guardrail Providers​
Add safety and content filtering to LLM calls.
Lakera AI
Prompt injection detection.
Azure Content Safety
Content moderation.
Bedrock Guardrails
AWS Bedrock safety.
OpenAI Moderation
OpenAI content policy.
Secret Detection
Prevent credential leaks.
PII Masking
Mask sensitive data.
View all guardrail providers →
Policies​
Define and enforce usage policies across your LLM deployment.
Guardrail Policies
Policy-based guardrail rules.
Policy Flow Builder
Visual policy configuration.
Policy Templates
Pre-built policy templates.
AI Tools​
Connect LiteLLM to AI-powered coding and productivity tools.
OpenWebUI
Self-hosted ChatGPT-style interface.
Claude Code
Use LiteLLM with Claude Code.
Cursor
AI code editor integration.
GitHub Copilot
GitHub Copilot integration.
OpenCode
Open source coding assistant.
Retool Assist
Retool AI assistant.
Agent SDKs​
Use LiteLLM with agent frameworks and SDKs.
OpenAI Agents SDK
Build agents with OpenAI's SDK.
Claude Agent SDK
Build agents with Anthropic's SDK.
Google ADK
Google Agent Development Kit.
CopilotKit
In-app AI copilots.
Letta
Build stateful LLM agents with persistent memory.
LiveKit
Real-time voice and video AI agents.
Prompt Management​
Manage, version, and deploy prompts.
LiteLLM Prompt Management
Built-in prompt management.
Custom Prompt Management
Bring your own prompt store.
Arize Phoenix Prompts
Prompt management with Phoenix.
Manage with AI Agents​
Use AI agents to manage your LiteLLM deployment: create users, teams, keys, models, and more via natural language.