4 ms·
This link is the most worthwhile hijack of an HN thread that I've ever seen. How is tiny.en so damned accurate? How much faster does this run natively? Do th
by jancsika 4y ago
This link is the most worthwhile hijack of an HN thread that I've ever seen.
How is tiny.en so damned accurate?
How much faster does this run natively?
Do the NEON instructions work for arm devices like an RPI or is it just tuned for Apple?
With this and Alpaca 13B you could probably replace an entire window manager.
Edit: it seems like it was less than a year ago that local speech recognition was a slow slog through a swamp of crufty, complicated research projects with most the high quality training data hidden behind walled gardens. Now I can stutter-step over a word and a demo in my browser correctly transcribes what I meant sans stutter. What happened?
- lxe 4y agoSIMD support in wasm is a bit weird. You'll need to compile into multiple targets, and many compile flags are not supported: https://emscripten.org/docs/porting/simd.html https://emscripten.org/docs/porting/simd.html
- anotherhue 4y agoYes NEON works on recent Pis. RPi CPU tuning: https://github.com/ggerganov/whisper.cpp/blob/70567eff232773d6786c91585d040f53c36b87a4/Makefile#L172 https://github.com/ggerganov/whisper.cpp/blob/70567eff232773...