3 ms·
If LPDDR6 PIM ever becomes a thing then the advantage of HBM will shrink. I'm not saying LPDDR6 PIM will make HBM obsolete in the datacenter or where it is curr
by imtringued 5d ago
If LPDDR6 PIM ever becomes a thing then the advantage of HBM will shrink. I'm not saying LPDDR6 PIM will make HBM obsolete in the datacenter or where it is currently shining, I'm saying that large volumes have their own charm and it is more likely for LPDDR6 PIM to be in your laptop or smartphone or SBC than HBM.
LPDDR6 PIM would primarily help the low end and mid range accelerator market. E.g. embedded models running on SBCs can be up to 1 GiB in size with acceptable performance, small models at 8 GiB become really easy to run at reasonable speeds on a smartphone and PIM enabled laptops or mini PCs make it possible to run 32 GiB models locally without compromise.
Of course this also assumes that the associated accelerators (NPUs) will catch up too, but the general point is that you won't need a 5090 or a 4090 anymore.