3 ms·
Anyone know if whisper.cpp is GPU accelerated yet?
by Ono-Sendai 3y ago
Anyone know if whisper.cpp is GPU accelerated yet?
- aidenn0 3y agoAFAIK it's not fully, but you can use cuBLAS/clBlast for a pretty good speedup.
- regularfry 3y agoPartially. Keep an eye out for ggml-cuda.cu getting updated.