4 ms·
Will these GenAI clusters have similar interconnects and ability to run scientific computing/HPC codes? AI has moved over to ASICS and GPUs nowadays, right? I a
by bee_rider 3y ago
Will these GenAI clusters have similar interconnects and ability to run scientific computing/HPC codes? AI has moved over to ASICS and GPUs nowadays, right? I also have no idea what their interconnect requirements are, but the task seems pretty low communication, I wonder if they can get by with a cheaper interconnect.
- the_svd_doctor 3y agoAI training requires a lot of global reductions which must be very fast otherwise everything slows down. So they also require fast and low latency interconnects.