Projects like this are the tip of the iceberg... While ROCm users celebrate finding just the right configuration to get PyTorch not to crash, Nvidia shops are

Projects like this are the tip of the iceberg... While ROCm users celebrate finding just the right configuration to get PyTorch not to crash, Nvidia shops are deploying solutions in production with stuff like this, FasterTransformer, Triton Inference Server, etc, etc. People (fairly) complain about Nvidia price points but they put a lot of work in on the software side to get a lot of value out of their products. At the point you’re deploying with a fully tuned and optimized stack built on dozens of Nvidia software components that get 10x the perf of AMD you’re thrilled you only paid 5x as much for the hardware.