📄️ Elasticsearch Logging with LiteLLM
Send your LLM requests, responses, costs, and performance data to Elasticsearch for analytics and monitoring using OpenTelemetry.
📄️ Benchmark LLMs
Easily benchmark LLMs for a given question by viewing
📄️ Reliability test Multiple LLM Providers with LiteLLM
* Quality Testing
📄️ Evaluate LLMs - MLflow Evals, Auto Eval
Using LiteLLM with MLflow
📄️ Benchmark LLMs - LM Harness, FastEval, Flask
LM Harness Benchmarks