4 ms·
We've significantly optimized multinode on AMD MI300X for both stability and performance at TensorWave. There were certainly a lot of challenges, but we've beco
by darrick_horton 2y ago
We've significantly optimized multinode on AMD MI300X for both stability and performance at TensorWave. There were certainly a lot of challenges, but we've become experts at multinode on AMD. We'd be happy to show you the latest results! They are quite compelling
- latchkey 2y agoPromises... promises... https://x.com/DarrickHorton/status/1828902979875017003 https://x.com/DarrickHorton/status/1828902979875017003 Maybe challenging for Darrick, but in reality, you just need to follow the directions and configure things correctly... https://techdocs.broadcom.com/us/en/storage-and-ethernet-connectivity/ethernet-nic-controllers/bcm957xxx/adapters/Configuration-adapter/configuring-nccl-and-gpudirect-with-bcm5750x-network-adapters/configuring-peer-memory-direct-with-amd-gpus.html https://techdocs.broadcom.com/us/en/storage-and-ethernet-con...