3 ms·
Hell yeah. Good luck!
by nullstyle 3y ago
Hell yeah. Good luck!
- Falimonda 3y agoDo you know if there's anything out there like LiteLLM that includes OpenAI's whisper model? I took a look at the litellm package and it doesn't appear they support the audio module. :/
- nullstyle 3y agoI'm not sure if it is _fully_ openai compatible, but whispercpp has a server bundled that says it is "OAI-like": https://github.com/ggerganov/whisper.cpp/tree/master/examples/server https://github.com/ggerganov/whisper.cpp/tree/master/example... I don't have any direct experience with it... I've only played around with whisper locally, using scripts.
- khimaros 3y agohttps://github.com/mudler/LocalAI https://github.com/mudler/LocalAI