> I am guessing that Apple has a lead in this stuff. Are Intel or AMD copying them at all? Not exactly. The AMD chip you are thinking of is the MI300, and it

> I am guessing that Apple has a lead in this stuff. Are Intel or AMD copying them at all? Not exactly. The AMD chip you are thinking of is the MI300, and it was originally a giant server APU with 24 cores. It was marketed as a HPC supercomputer chip. Intel had something similar, Falcon Shores, a big APU. ...And as it turns out, almost no one cared. The ML industry doesn't want unified memory APUs, an inference chip, a training chip, a bigger training chip, and so on. They want Nvidia GPUs. Everything is already coded to work with this "second computer that plugs in," as you said, so thats what customers want. Even Nvidia themself seems to be spinning their wheels with grace-hopper. So AMD spun a MI300 into a variant with an even bigger GPU and no CPU. And they emulated CUDA (a work in progress). Intel canceled Falcon shores and redid it as a pure GPU, with their other AI IP (Gaudi) baked in like tensor cores. With a 2 year delay. And they are moving heaven and earth to support PyTorch and other frameworks out-of-the-box. I can't emphasize how disruptive this is, especially for Intel. Silicon takes years and 9+ figures to design. They would not have made these moves if there was even modest short-term interest in unified memory chips for AI.