A follow up on this - I came up with an interesting strategy to achieve this. Still a prototype, but I think it looks very promising: https://github.com/ggerga

A follow up on this - I came up with an interesting strategy to achieve this. Still a prototype, but I think it looks very promising: https://github.com/ggerganov/whisper.cpp/pull/271 https://github.com/ggerganov/whisper.cpp/pull/271 The source code is in the `command.cpp` and I will soon write some more details how it works. If you give it a try, definitely let me know if it worked for you.