Set up environment
Let's get the necessary keys to set up our demo environment.
Create your first LLM playground
Create a playground to evaluate multiple LLM Providers in less than 10 minutes. If you want to see this in prod, check out our website.
Using Text Completion Format - with Completion()
If your prefer interfacing with the OpenAI Text Completion format this tutorial covers how to use LiteLLM in this format
Mock Completion Responses - Save Testing Costs
Trying to test making LLM Completion calls without calling the LLM APIs ?
provider_specific_params
Setting provider-specific Params
Gradio Chatbot + LiteLLM Tutorial
Simple tutorial for integrating LiteLLM completion calls with streaming Gradio chatbot demos
Replacing OpenAI ChatCompletion with Completion()
* Supported OpenAI LLMs
Llama Together AI Tutorial
https://together.ai/
Llama2 - Huggingface Tutorial
Huggingface is an open source platform to deploy machine-learnings models.
CodeLlama - Code Infilling
This tutorial shows how you can call CodeLlama (hosted on Huggingface PRO Inference Endpoints), to fill code.
Using Fine-Tuned gpt-3.5-turbo
LiteLLM allows you to call completion with your fine-tuned gpt-3.5-turbo models
Oobabooga Text Web API Tutorial
Install + Import LiteLLM