2 ms·
Is there a recommended dev platform to test this model? e.g. Google/Coral TPU, Nvidia Jetson Nano, Rockchip RK3568 NPU, iPhone/Android NPU, ..?
by walterbell 4y ago
Is there a recommended dev platform to test this model? e.g. Google/Coral TPU, Nvidia Jetson Nano, Rockchip RK3568 NPU, iPhone/Android NPU, ..?
- nshm 4y agoCoral and Jetson are not very powerful actually, you can't run even medium model in realtime. https://github.com/openai/whisper/discussions/417 https://github.com/openai/whisper/discussions/417 And there is latency issue too, you won't get response very fast. If you look for <0.5s latency or the answer, you need to try something like Vosk probably.