4 ms·
I ship an app (Talon) which runs many kinds of wav2letter ASR models on consumer CPUs. It has real-time inference pipelines for both pytorch and flashlight. (I
by lunixbochs 6y ago
I ship an app (Talon) which runs many kinds of wav2letter ASR models on consumer CPUs. It has real-time inference pipelines for both pytorch and flashlight. (I wrote the pytorch code). Performance of both inference pipelines is fine and comparable between the frameworks for me. I'm not sure what you're talking about wrt speech recognition performance.
Maybe for training? But there aren't that many cpu bound components there, and you can write those in native code.
- whimsicalism 6y agoFair enough, I've followed your stuff a bit and you definitely know more about Flashlight than I do. What would you say the motivation is for yet another ML framework, but in C++ this time?