3 ms·
What about NVLink? I'm pretty sure there is no equivalent for AMD right? That would be a pretty big deal.
by nightski 9y ago
What about NVLink? I'm pretty sure there is no equivalent for AMD right? That would be a pretty big deal.
- jamesblonde 9y agoNVLink is good if you are doing distributed training and sharing large amounts of gradients (very large models). If you're doing parallel experiments or your models are not huge, then PCI-e (16 GB/s) is generally good enough. AMD don't have anything close that i am aware of, but their new Ryzen board will have double the number of PCI lanes, which makes PCI-e competitive again - https://news.ycombinator.com/item?id=14450924 https://news.ycombinator.com/item?id=14450924