For consumer devices that don't need much RAM, that makes sense, but for servers, I imagine it'll end up as more of an (optionally) tiered set-up, if you look a

For consumer devices that don't need much RAM, that makes sense, but for servers, I imagine it'll end up as more of an (optionally) tiered set-up, if you look at the Sapphire Rapids chips with HBM on, they can be run with only that, but they can also be run with it as another cache layer, or as a separate faster memory region. If you need an absolute ton of memory, having it all directly on the die becomes impractical at some point.