MI250 (which is two GPUs) has 128 GB and H100 NVL (also two GPUs) has 188 GB at 7.8 TB/s. Both are probably an order of magnitude more expensive than a 4090 so

MI250 (which is two GPUs) has 128 GB and H100 NVL (also two GPUs) has 188 GB at 7.8 TB/s. Both are probably an order of magnitude more expensive than a 4090 so they're not really in the same class.