4 ms·
The memory bandwidth has not been announced for this device. It's probably going to be more appropriate to compare vs a 128GB M4 Max (410-546GB/s MBW) or an AMD
by lhl 2y ago
The memory bandwidth has not been announced for this device. It's probably going to be more appropriate to compare vs a 128GB M4 Max (410-546GB/s MBW) or an AMD Ryzen AI Max+ 395 (yes, that's its real name) at 256GB/s of MBW.
The 5090 has 1.8TB/s of MBW and is in a whole different class performance-wise.
The real question is how big of a model will you actually want to run based on how slowly tokens generate.
- elorant 2y agoWell obviously it has to be low otherwise they would cannibalize their high end GPUs.