2 ms·
That's 32GB per socket, with current technology. Assume that in 1-2 years HBM capacity doubles, and it's a quad-socket motherboard. You'd have 64GB per socket,
by jiggawatts 7y ago
That's 32GB per socket, with current technology.
Assume that in 1-2 years HBM capacity doubles, and it's a quad-socket motherboard. You'd have 64GB per socket, or 256GB total.
Remind me how much memory an NVIDIA accelerator has?
To play Devil's advocate, putting HBM2 in the package doesn't magically solve everything. The intra-socket bandwidth could be enormous, but the inter-socket bandwidth would still be whatever it is now, and would be difficult to increase.
- kllrnohj 7y ago> and it's a quad-socket motherboard Epyc doesn't do quad sockets. Is this just another hypothetical "what if" at this point with no basis in reality? Because sure, a hypothetical non-existent Epyc re-designed to compete in the double precision floating point space favoring memory bandwidth above all else could be really cool. Then again, so could anything else custom designed exclusively for that use case. > but the inter-socket bandwidth would still be whatever it is now, and would be difficult to increase. 64 PCI-E 4.0 lanes form the CPU-CPU interconnect currently. Since we're making up stuff why not assume that's doubled next generation along with being PCI-E 5.0? So that'd be 500GB/s give or take.