2 ms·
How do we know this is the largest ML facility in the field? Can anybody rule out the idea that I could go to GCP right now and launch 1500 nodes with 4 GPUs ea
by jeffbee 5y ago
How do we know this is the largest ML facility in the field? Can anybody rule out the idea that I could go to GCP right now and launch 1500 nodes with 4 GPUs each?
- stonogo 5y agoDo it! You'll make the news, and then fifteen minutes later NERSC will still be the largest ML facility in the field. The HPC community is accustomed to stunt machines, and accustomed to disregarding the ones that don't wind up enabling meaningful research.
- jeffbee 5y agoThat wasn't really much of a quantitative argument. Tons of meaningful research has been done in clouds. Granted, it was often by the owner of the cloud, but there it is. So is there anything we can compare? Does it train resnet-50 in a split second or what?
- freeone3000 5y ago1500 compute nodes on GPC don't make a supercomputer the same way that all the computers on campus don't. Table stakes are a high speed interconnect, shared data storage, and a job scheduler. I know of a few devices built out of DGX machines with InfiniBand interconnects that are about half the size, and they were massive projects as well. You can't get there from generic cloud compute.
- the_svd_doctor 5y agoThe difference is probably the interconnect, no? What does GCP have between nodes?
- jeffbee 5y agoAccording to the article, HPE/Cray 200gb ethernet. GCP A2 instances with 16 GPUs have 100gb ethernet. I'm not sure it's very important, would depend on the workload.
- mirker 5y agoMy understanding is the title is “fastest”, which is 3.8 exaflops of sparse fp16. I assume these are theoretical peak or “benchmark” peak performance. Replicating their hardware in the cloud would get you the same title until a concrete workload is used.