2 ms·
Hybrid memory systems are famously difficult to work with. See XBox 360 eDRAM, Xeon Phi (DDR4 + HMC version), among others. Its a computer architecture that ke
by dragontamer 6y ago
Hybrid memory systems are famously difficult to work with.
See XBox 360 eDRAM, Xeon Phi (DDR4 + HMC version), among others. Its a computer architecture that keeps showing up every few years... programmers get frustrated with the split-memory architecture. So its rare for such a system to ever become popular.
----------
HBM RAM doesn't have any better latency characteristics than DDR4. Traversing a linked-list in HBM will take the same amount of time (maybe even a bit longer) than DDR4. As such, its non-obvious how to optimize the split-memory operations.
NUMA-style mallocs / frees (malloc to a particular memory location) don't really match the performance characteristics either. Its not that one or the other RAM has better latency... its that one RAM has more BANDWIDTH than the other. NUMA-style is already more complicated than most programmers are willing to work with, and yet its still not enough to capture the performance attributes of HBM vs DDR4.