3 ms·
The latency is excusable as this is through the API. Inference on local infrastructure is almost instant so this demo would smoke everything else if this dude h
by razodactyl 3y ago
The latency is excusable as this is through the API. Inference on local infrastructure is almost instant so this demo would smoke everything else if this dude had access.