4 ms·
This was my instinct when NVMe SSDs first came out: I'd joke that now we have 2 TB of RAM. The real joke is on me though, some of these GPU servers actually ha
by kevmo314 9mo ago
This was my instinct when NVMe SSDs first came out: I'd joke that now we have 2 TB of RAM.
The real joke is on me though, some of these GPU servers actually have 2 TB of RAM now. Crazy engineering!
- npn 9mo agoNow? I had found some used epyc servers with 2TB ddr4 ram for around 5k usd yesteryear. Too bad I didn't purchase it.
- sroussey 9mo agoHe said GPU servers
- esjeon 9mo agoThe point is that we did have CPU servers with TBs of RAM. These machines are still pretty much relevant.
- npn 9mo agoHe didn't say VRAM. GPU servers are just servers with GPUs.
- sroussey 9mo agowho cares how much cpu ram a gpu server has? But yeah, if that is what he meant, then that is silly. Although... may be impossible to buy 2TB of RAM later in 2026! ;)