4 ms·
Connectivity at the datacenter level can’t be solved that easily. NVIDIA built its switch chip to connect GPUs and acquired MLNX.
by startupsfail 4y ago
Connectivity at the datacenter level can’t be solved that easily. NVIDIA built its switch chip to connect GPUs and acquired MLNX.
- lmeyerov 4y agoThis. Most ML people we work with, including new hires, are CPU-first and don't think in bandwidth/throughput, so we have to untrain basically every DS hire to this. Nvidia SW+HW is so far ahead here as they got it early. Sure, Intel will pay startups to port individual algs to make some steps do well, but the ecosystem gap is just getting bigger. AMD/Intel/etc are still playing catch-up to status quo from years ago, while we work with Nvidia on next-gen and making accessible. Ex: GPUDirect over parallel SSD arrays is nuts.. and you can do it in python! Only really Google is competitive here (limited to ~TF), and maybe one day Apple.