Elasticsearch Logging with LiteLLM
Send your LLM requests, responses, costs, and performance data to Elasticsearch for analytics and monitoring using OpenTelemetry.
Benchmark LLMs
Easily benchmark LLMs for a given question by viewing
Reliability test Multiple LLM Providers with LiteLLM
* Quality Testing
Evaluate LLMs - MLflow Evals, Auto Eval
Using LiteLLM with MLflow
Benchmark LLMs - LM Harness, FastEval, Flask
LM Harness Benchmarks