2 ms·
AMD has a viable competitor to H100 but no one buys it because it doesn’t support CUDA.
AMD has a viable competitor to H100 but no one buys it because it doesn’t support CUDA.
It’s actually better than the H100 by a mile in some inference workloads, but in others falls behind.
that's surprising to me. Torch supports ROCm, why are startups wasting their money on H100s if they can get a better deal with AMD GPUs?