Skip to main content

LiteLLM Global Control Plane API is now available

LiteLLM Global Control Plane APIOne LiteLLM control plane manages four independent deployments: AWS EKS with Aurora and ElastiCache, Azure AKS with Azure Database for PostgreSQL and Azure Redis, GCP GKE with Cloud SQL and Memorystore, and on-premises Kubernetes with PostgreSQL and Redis. Connections from LiteLLM represent management traffic.

The LiteLLM Global Control Plane API is now available. Manage deployments across regions and clouds while keeping their databases, Redis instances, and credentials separate.

The Global Control Plane previously provided a UI for managing multiple deployments. The new API brings that management to scripts, automation, and internal platforms.

Isolate database and Redis failures​

Each regional gateway uses its own PostgreSQL database and Redis instance. This limits the impact of a database or Redis outage to the affected deployment. Other deployments continue serving inference with their own dependencies.

Applications send inference requests directly to their regional gateway. Regional inference also continues if the control plane is unavailable.

Keep data isolated​

Separate deployments by region or team, with local keys, teams, budgets, provider credentials, and storage. Each deployment's database and Redis stay in its own environment. The control plane receives management and usage data.

Use the API to manage keys, teams, models, and budgets on a selected deployment. You can restrict operators to specific deployments and roles, and each gateway also checks the caller's local permissions.

Get started​

The Global Control Plane API requires a LiteLLM Enterprise license. Read the setup guide for configuration, API examples, and reference architectures for AWS, Azure, GCP, and hybrid cloud.