3 ms·
How fast is inference with this model? For reference, I'm using 11Labs to synthesize short messages - maybe a sentence or something, using voice cloning, and I
by svapnil 3y ago
How fast is inference with this model?
For reference, I'm using 11Labs to synthesize short messages - maybe a sentence or something, using voice cloning, and I'm getting it at around 400 - 500ms response times.
Is there any OS solution that gets me to around the same inference time?
- wczekalski 3y agoIt depends on hardware but IIRC on V100s it took 0.01-0.03s for 1s of audio.