3 ms·
Shameless plug: recently launched LLMStack (https://github.com/trypromptly/LLMStack https://github.com/trypromptly/LLMStack) and I have some custom pipelines bu
by ajhai 3y ago
Shameless plug: recently launched LLMStack (https://github.com/trypromptly/LLMStack https://github.com/trypromptly/LLMStack) and I have some custom pipelines built as apps on LLMStack that I use to transcribe and translate.
Granted my use cases are not high volume or frequent but being able to take output from Whisper and pipe it to other models has been very powerful for me. It is also amazing how good the quality of Whisper is when handling non English audio.
We added LocalAI (https://localai.io https://localai.io) support to LLMStack in the last release. Will try to use whisper.cpp and see how that compares for my use cases.