3 ms·
That is only the case for networking inside of a single physical machine. Most HPC MPI use cases span many machines, for which this is typical latency of ethern
by montecarl 13y ago
That is only the case for networking inside of a single physical machine. Most HPC MPI use cases span many machines, for which this is typical latency of ethernet.
- codemac 13y agoIn cases where I've used OpenMPI it was spanning machines as well as being multiple processes on the same box. The goal was making that interchangeable (in my use case). I imagine google's compute engine isn't all on separate machines, but utilizes VMs heavily.. although it's probably a bad idea to put one customer's VM's on all the same box. That's a long way of saying "of course you're right, I guess my thought doesn't contribute as much as I thought" :)
- montecarl 13y agoYou are also right of course. Intra-machine latency is quite important. Many problems can be decomposed in to smaller parallel parts that can be done per machine.