3 ms·768GB Intel Optane DIMMs to run 1T-parameter LLM with single GPU at 4tps30 points by walterbell 5mo agolostmsu 5mo agoThe bottleneck in this setup is PCIe bus. You don't need optane to saturate it. 4 regular SSDs might do just fine.musicale 5mo agoAh Optane, what might have been... Even over PCIe, I imagine the advantage vs. NVMe is lower latency and more operations per second.