deepgram
, fireworks ai
, vision
, admin ui
, dependency upgrades
New Modelsโ
Deepgram Speech to Textโ
New Speech to Text support for Deepgram models. Start Here
from litellm import transcription
import os
# set api keys
os.environ["DEEPGRAM_API_KEY"] = ""
audio_file = open("/path/to/audio.mp3", "rb")
response = transcription(model="deepgram/nova-2", file=audio_file)
print(f"response: {response}")
Fireworks AI - Vision support for all modelsโ
LiteLLM supports document inlining for Fireworks AI models. This is useful for models that are not vision models, but still need to parse documents/images/etc.
LiteLLM will add #transform=inline
to the url of the image_url, if the model is not a vision model See Code
Proxy Admin UIโ
Test Key
Tab displaysmodel
used in response
Test Key
Tab renders content in.md
,.py
(any code/markdown format)
Dependency Upgradesโ
- (Security fix) Upgrade to
fastapi==0.115.5
https://github.com/BerriAI/litellm/pull/7447
Bug Fixesโ
- Add health check support for realtime models Here
- Health check error with audio_transcription model https://github.com/BerriAI/litellm/issues/5999