4 ms·
But even the most powerful apple silicon GPU is terrible compared to an average Nvidia chip
by jcelerier 11mo ago
But even the most powerful apple silicon GPU is terrible compared to an average Nvidia chip
- swiftcoder 11mo agoWhile I agree with the general point, this statement is factually incorrect - apple's most powerful laptop GPU punches right about the same as the laptop SKU of the RTX 4070, and the desktop Ultra variant punches up with a 5070ti. I'd say on both fronts that is well above the average.
- Rohansi 11mo agoAnd it will consume almost as much power as the Nvidia GPU to do so.
- Rapzid 11mo agoThere is no world where Apple silicone is competing with a 5070ti on modern workloads. Not the hardware and certainly not the software where Nvidia DLSS is in it's own air with AMD just barely having gotten AI upscaling out and started approximating ray reconstruction.
- swiftcoder 11mo agoApple's MetalFX upscaler is pretty similar to DLSS (and I think well ahead of AMD's efforts on this front). Ray tracing outside of Nvidia is a disaster all round, so yeah, nobody is competing on that front.
- rxyz 11mo agoRay tracing support on the newest AMD chips is getting good enough. They are still behind Nvidia but definitely not a disaster anymore
- michaelt 11mo agoCertainly, nobody would buy an Apple hoping to run triple-A PC games. But among people running LLMs outside of the data centre, Apple's unified memory together with a good-enough GPU has attracted quite a bit of attention. If you've got the cash, you can get a Mac Studio with 512GB of unified memory. So there's one workload where apple silicon gives nvidia a run for their money.
- gehsty 11mo agoOnly in the size of model it can run, not speed of token generation.
- jayd16 11mo agoAre there real world game benchmarks for this or are these synthetic tests?
- swiftcoder 11mo agoOnly a few, because it's not easy to find contemporary AAA games with native macOS ports. Notebookcheck has some comparisons for Assassins Creed: Shadows and Cyberpunk 2077[1] [1]: https://www.notebookcheck.net/Cyberpunk-AC-Shadows-on-Apple-s-M4-Max-Gaming-performance-comparable-to-the-RTX-5060-Laptop.1166765.0.html https://www.notebookcheck.net/Cyberpunk-AC-Shadows-on-Apple-...
- throwaway314155 11mo agoThat simply isn't true. I have an RTX 4070 gaming PC and an M4 MacBook Pro w/ 36GB shared memory. When models fit in VRAM, the RTX 4070 still runs much faster. Maybe the next generation M5 chips are faster but they can't be 2-4x faster.
- magicalhippo 11mo agoGP said laptop 4070. The laptop variants are typically much slower than the desktop variants of the same name. It's not just power budget, the desktop part has more of everything, and in this case the 4070 mobile vs desktop turns out to be a 30-40% difference[1] in games. Now I don't have a mac so if you meant "2-5x" when you said "much faster" well thdn yea, that 40% difference isn't enough to overcome that. [1]: https://nanoreview.net/en/gpu-compare/geforce-rtx-4070-mobile-vs-geforce-rtx-4070 https://nanoreview.net/en/gpu-compare/geforce-rtx-4070-mobil...
- jcelerier 11mo agoa 4.5k$ M4 Max barely competes with an entry-level laptop with a 4060 which will be around ~1K in FPS in cyberpunk given the same settings. For AI it's even worse - on NVidia hardware you're getting double-digit speeds for FPS for real-time inference of e.g. stable diffusion, whereas on the M2 Max I have you get at best 0.5 FPS