2 ms·
It's even more. You also need to fund power and maintain infrastructure to run the GPUs. You need to build fast networks between the GPUs for RDMA. Ethernet
by etc-hosts 2y ago
It's even more. You also need to fund power and maintain infrastructure to run the GPUs. You need to build fast networks between the GPUs for RDMA. Ethernet is going to be too slow. Infiniband is unreliable and expensive.
- FridgeSeal 2y agoYou’ll also need sufficient storage, and fast IO to keep them fed with data. You also need to keep the later generation cards from burning themselves out because they draw so much. Oh also, depending on when your data centre was built, you may also need them to upgrade their power and cooling capabilities because the new cards draw _so much_.