3 ms·
If you put the memory on the same package as the CPU it can have higher bandwidth without needing an unreasonably high number of pins in the CPU socket. But th
by AnthonyMouse 3y ago
If you put the memory on the same package as the CPU it can have higher bandwidth without needing an unreasonably high number of pins in the CPU socket.
But there is no reason you can't do both. Intel is already by putting HBM on the Xeon Max. It still has separate memory slots, because they're for two different things. HBM is fast and expensive. DDR costs less so you can have more of it for the same amount of money and the large majority of workloads aren't memory-bound.
You could then have systems with DIMM slots that aren't populated because the CPU has enough HBM to satisfy you, others that cost less with no HBM and the same amount of DDR, and still others that have say 16GB of HBM and 128GB of DDR. Both of which are still upgradable, but if you want more HBM it comes with a new CPU.