Connect apps and providers

📄️ Set up environment

Let's get the necessary keys to set up our demo environment.

Create a playground to evaluate multiple LLM Providers in less than 10 minutes. If you want to see this in prod, check out our website.

If your prefer interfacing with the OpenAI Text Completion format this tutorial covers how to use LiteLLM in this format

Trying to test making LLM Completion calls without calling the LLM APIs ?

Setting provider-specific Params

Simple tutorial for integrating LiteLLM completion calls with streaming Gradio chatbot demos

* Supported OpenAI LLMs

https://together.ai/

Huggingface is an open source platform to deploy machine-learnings models.

This tutorial shows how you can call CodeLlama (hosted on Huggingface PRO Inference Endpoints), to fill code.

LiteLLM allows you to call completion with your fine-tuned gpt-3.5-turbo models

Install + Import LiteLLM