3 ms·
Cool. Apple was the only one who managed to ship a consumer device with UMA and RDMA support. 2TB VRAM max over RDMA.
by throw1234567891 4mo ago
Cool. Apple was the only one who managed to ship a consumer device with UMA and RDMA support. 2TB VRAM max over RDMA.
- vkazanov 4mo agoI think the REALLY cool thing about apple's shared memory implementation is the ultra-wide memory bus. Otherwise, AMD is quite close to what Apple has, and Strix Halo is honestly incredible. Not sure what RDMA brings to the table.
- throw1234567891 4mo agoRDMA increases the inference performance by a significant percentage across devices connected via Thunderbolt 5.4x512 is like a 2TB machine.
- boredatoms 3mo agoThunderbolt RDMA is slower and higher latency than if apple just gave us PCIe, where we could put a (old) connectX card in for infiniband