File Search in the Responses API
LiteLLM now supports file_search in the Responses API across both:
Chat with sample documents in MongoDB (BETA)
Create three fictional policy documents, index them in MongoDB Atlas, test semantic search in the LiteLLM Admin UI, and use the results in a chat completion. The sample text below was written for this tutorial and does not describe real company policies.
Using Anthropic File API with LiteLLM Proxy
Overview
Call Gemini Realtime API with Audio Input/Output
1. Setup config.yaml for LiteLLM Proxy