3 ms·
Yea, whisper runs fairly quickly on really old GPUs and leveraging CTranslate2 (underlying tech in your link) you need < 4GB of GPU RAM to run the large model.
by ttt3ts 3y ago
Yea, whisper runs fairly quickly on really old GPUs and leveraging CTranslate2 (underlying tech in your link) you need < 4GB of GPU RAM to run the large model.
This might be faster but an order of magnitude more expensive? Also, huge lockin to one provider.