How we made the LiteLLM Usage page 120x faster
This week, we made the LiteLLM Usage page roughly 120x faster.
With 5,000 API keys, our Usage page took over six minutes to show 30 days of totals. We redesigned how it loads data and brought that down to 3.2 seconds in our benchmark. That's roughly 120x faster.