Skip to main content

Adding LLM Credentials

You can add LLM provider credentials on the UI. Once you add credentials you can re-use them when adding new models

Add a credential + model​

1. Navigate to LLM Credentials page​

Go to Models -> LLM Credentials -> Add Credential

2. Add credentials​

Select your LLM provider, enter your API Key and click "Add Credential"

Note: Credentials are based on the provider, if you select Vertex AI then you will see Vertex Project, Vertex Location and Vertex Credentials fields

3. Use credentials when adding a model​

Go to Add Model -> Existing Credentials -> Select your credential in the dropdown

Create a Credential from an existing model​

Use this if you have already created a model and want to store the model credentials for future use

1. Select model to create a credential from​

Go to Models -> Select your model -> Credential -> Create Credential

2. Use new credential when adding a model​

Go to Add Model -> Existing Credentials -> Select your credential in the dropdown

Frequently Asked Questions​

How are credentials stored? Credentials in the DB are encrypted/decrypted using LITELLM_SALT_KEY, if set. If not, then they are encrypted using LITELLM_MASTER_KEY. These keys should be kept secret and not shared with others.