4 ms·

Also, with GPUs, because of the additional compute power on the server, the network quickly becomes a bottleneck.