CLI Arguments
This page documents all command-line interface (CLI) arguments available for the LiteLLM proxy server.
Server Configuration
--host
- Default:
'0.0.0.0' - The host for the server to listen on.
- Usage:
litellm --host 127.0.0.1 - Usage - set Environment Variable:
HOST
export HOST=127.0.0.1
litellm
--port
- Default:
4000 - The port to bind the server to.
- Usage:
litellm --port 8080 - Usage - set Environment Variable:
PORTexport PORT=8080
litellm
--num_workers
- Default:
1, or the value of theDEFAULT_NUM_WORKERS_LITELLM_PROXYenvironment variable if set - The number of worker processes to spin up (uvicorn, gunicorn, or Granian
--workers). - Usage:
litellm --num_workers 4 - Usage - set Environment Variable:
NUM_WORKERSexport NUM_WORKERS=4
litellm