3 ms·
We have benchmarks[0] for Willow Inference Server using Whisper + ctranslate2 + some of our own optimizations. TLD a six year old ~$100 used GTX 1070 is roughl
by kkielhofner 3y ago
We have benchmarks[0] for Willow Inference Server using Whisper + ctranslate2 + some of our own optimizations.
TLD a six year old ~$100 used GTX 1070 is roughly 5x faster than a Threadripper PRO 5955WX at a fraction of the cost and power.
[0] - https://heywillow.io/components/willow-inference-server/#benchmarks https://heywillow.io/components/willow-inference-server/#ben...
- RecycledEle 3y ago> TLD a six year old ~$100 used GTX 1070 is roughly 5x faster Did you mean TIL?