3 ms·
Put a discrete GPU and most of the magic of unified memory goes out the window. The M3 Ultra should be able to use up to 256GB of high bandwidth RAM. That blows
by aurareturn 3y ago
Put a discrete GPU and most of the magic of unified memory goes out the window. The M3 Ultra should be able to use up to 256GB of high bandwidth RAM. That blows away any discrete GPU. Yes, it doesn't have the processing power of a dedicated professional Nvidia card but I don't think Apple is trying to compete there. Apple is trying to fill the high VRAM niche. They might have a real advantage there considering LLMs require a ton of memory.
If Apple ever makes an "M3 Extreme" by gluing 4x Max dies together, they could have up to 512GB of VRAM. You'd need to 7x H100 GPUs to match total RAM size which will cost you $210k.
- rmorey 3y agoI heard a really sad report (via anonymous apple employee on the podcast ATP.fm, I'll try to find the episode) that they have totally canned the "Extreme" i.e 4xMax project entirely, for at least the next several revision cycles.