2 ms·
Has someone already compared to whisper.cpp running on the CPU with cuBLAS on the GPU? That was a lot more than 4x faster than whisper on the CPU, and was suff
by aidenn0 3y ago
Has someone already compared to whisper.cpp running on the CPU with cuBLAS on the GPU? That was a lot more than 4x faster than whisper on the CPU, and was sufficiently parsimonious with GPU ram to allow me running even the large model (and without quitting firefox, which is a bit of a GPU ram hog).