3 ms·
Nice. LiteLLM was just the thing I've been looking for and hoping to integrate.
by Falimonda 3y ago
Nice. LiteLLM was just the thing I've been looking for and hoping to integrate.
- nullstyle 3y agoHell yeah. Good luck!
- Falimonda 3y agoDo you know if there's anything out there like LiteLLM that includes OpenAI's whisper model? I took a look at the litellm package and it doesn't appear they support the audio module. :/
- nullstyle 3y agoI'm not sure if it is _fully_ openai compatible, but whispercpp has a server bundled that says it is "OAI-like": https://github.com/ggerganov/whisper.cpp/tree/master/examples/server https://github.com/ggerganov/whisper.cpp/tree/master/example... I don't have any direct experience with it... I've only played around with whisper locally, using scripts.
- khimaros 3y agohttps://github.com/mudler/LocalAI https://github.com/mudler/LocalAI