3 ms·
They benchmarked several configurations, but I couldn't match up which configuration of models produced which results. I was trying to figure out if you drop th
by sp332 7y ago
They benchmarked several configurations, but I couldn't match up which configuration of models produced which results. I was trying to figure out if you drop the CPU power so throughput just handles one person talking at a normal pace, whether latency would necessarily get crazy high.