2 ms·
> Apple is the only company that makes integrated GPUs that are actually any good I will reiterate; if you have used AMD or Intel iGPUs recently you would know
by talldayo 2y ago
> Apple is the only company that makes integrated GPUs that are actually any good
I will reiterate; if you have used AMD or Intel iGPUs recently you would know this is just plain wrong. AMD's iGPUs often outperform Apple's for the price, and come with a featureset that isn't intentionally gimped and supports "professional" features like Vulkan conformance. People condemn Apple's GPUs for having a featureset too simple for anything besides video transcoding and compute shaders. If Intel didn't exist, Apple would probably be the single least-efficient and lowest performance GPU designer shipping products today. And they had to cut corners to get there.
> If you get more RAM for your Macbook, that automatically means more memory you can use for LLM inference.
And then it's your paltry GPU that's the bottleneck. You can get comparable results on pretty much any sub-120b parameter model with PCIe offloading on Nvidia hardware that costs a fraction of a Mac Studio with enough memory to compete.
See for yourself. Nvidia's fastest laptop chips still outperform Apple's most powerful desktop GPU chips: https://browser.geekbench.com/opencl-benchmarks https://browser.geekbench.com/opencl-benchmarks
And it's not even close. Apple's biggest professional GPUs struggle to swap spit with Nvidia's last-gen laptop chips.