4 ms·
Latency can destroy conversational rhythm. What’s your p95 inference time? also are there any benchmarks we can see?
by rasjonell 7mo ago
Latency can destroy conversational rhythm. What’s your p95 inference time?
also are there any benchmarks we can see?