The issue with AMD (and frankly AWS' custom accelerators) is more on the software side usually. ROCM is getting better but still lags far behind CUDA in adoptio

The issue with AMD (and frankly AWS' custom accelerators) is more on the software side usually. ROCM is getting better but still lags far behind CUDA in adoption and often performance. With things like inferentia, although the performance numbers they have reported are really impressive-- in practice, model compilation is super finnicky. I'd love to see how seamless they can make usage of trainium.