2 ms·
> The result for a 10 Minute audio is 0:03:36.296329 (216 seconds). Compare that to 0:03:06.707770 (186 seconds) on my Nvidia 4090. The 2000 € GPU is still 30 s
by etchalon 3y ago
> The result for a 10 Minute audio is 0:03:36.296329 (216 seconds). Compare that to 0:03:06.707770 (186 seconds) on my Nvidia 4090. The 2000 € GPU is still 30 seconds or ~ 16% faster. All graphics core where fully utilized during the run and I quit all programs, disabled desktop picture or similar for that run.
- lern_too_spel 3y agoWhat other people have mentioned is that there are multiple implementations for Nvidia GPUs that are many times faster than whisper.cpp.
- etchalon 3y agoAnd my comment was about M1 comparison articles, of which this was one. And which exhibited the property I mentioned.
- lern_too_spel 3y agoIt does this poorly. They compared the currently most optimized whisper implementation for M1 against an implementation that is far from the best currently available for the Nvidia GPU. They cannot make a claim of reaching 70% speed at 25% power usage. Edit: The article has been updated to compare against a faster implementation for the Nvidia GPU and no longer makes that claim.