> The MI250 has a larger amount of HBM memory (128GB) than even the largest A100 (80GB). This means the MI250 can hold larger models for training or inference.

> The MI250 has a larger amount of HBM memory (128GB) than even the largest A100 (80GB). This means the MI250 can hold larger models for training or inference. AMD put two individual devices together, so you can tell people the combined memory is more than Nvidia has to offer. > Overall we find that AMD MI250 achieves an average of ~80% of the per-GPU training throughput of A100-40GB and ~73% of A100-80GB So their two-device bundle with more memory and theoretical compute just can't compete with Nvidia's prior gen single device. Can MI300 compete with H100?