What about multi-gpu setups? Nvidia has nvlink, effectively combining any amount of GPUs into one speedy network, which can benefit both training and inference

What about multi-gpu setups? Nvidia has nvlink, effectively combining any amount of GPUs into one speedy network, which can benefit both training and inference speed for bigger model sizes. AFAIK, AMD doesn't have anything like that, thus, limiting the usefullness of these chips. Also, compute stack is too rough right now. Not sure ROCm will be comparable with CUDA in terms of usability in the next couple of years at least.