3 ms·
How does it run 400B models across two? I didn’t see that in the article
by stogot 2y ago
How does it run 400B models across two? I didn’t see that in the article
- tempay 2y ago> Nvidia says that two Project Digits machines can be linked together to run up to 405-billion-parameter models, if a job calls for it. Project Digits can deliver a standalone experience, as alluded to earlier, or connect to a primary Windows or Mac PC.
- FuriouslyAdrift 2y agoPoint to point ConnectX connection (RDMA with GPUDirect)
- sliken 2y agoNot sure exactly, but they mentioned linking to together with ConnectX, which could be ethernet or IB. No idea on the speed though.