> shared memory architectures like Intel's integrated GPUs or Apple's unified memory can't compare to dedicated GPU memory. It depends. For the initial prompt

> shared memory architectures like Intel's integrated GPUs or Apple's unified memory can't compare to dedicated GPU memory. It depends. For the initial prompt+context processing, iGPUs (and NPUs) are still a win because you're compute bound at that stage. For token generation, CPU is typically faster than iGPU (or even plausibly NPU) for local quantized models because it can make better use of all available memory bandwidth, with no wasteful padding reducing your usable throughput.