I've seen HBM as growingly niche & less interesting, but upcoming HBM3 seems to be quite a turn towards a more DDR like behavior: 5.2+ GT/s from 2.0GT/s, a huge

I've seen HBM as growingly niche & less interesting, but upcoming HBM3 seems to be quite a turn towards a more DDR like behavior: 5.2+ GT/s from 2.0GT/s, a huge jump, and channel width dropping from 8x gargantuan 128-bit channels to 16x reasonable-size-ish 64-bit channels. I'm not sure what if anything else would be required to escape HBM2's reputation for being high latency, but hopefully the situation is just better. AMD hasn't really sold HBM as far as I've seen since ~2018. Counter-point, upcoming Intel data-center GPUs seem loaded with HBM. I tend to believe this use case will be more permissive of the the higher latency, wider width HBM, that deep number crunching is less affected. Nvidia has HBM on their contemporary Axx Tesla accelerators- again, a case where aggregate number crunching with some internal latency is ok, unlike general GPU and CPU work.