2 ms·
Is that really all? We regularly run multi TB memory clusters for big data processing and ML. I imagined it would be much bigger than that. To put that in pers
by antonvs 4y ago
Is that really all? We regularly run multi TB memory clusters for big data processing and ML. I imagined it would be much bigger than that.
To put that in perspective, 24x 64 GB nodes is 1.5 TB.
- albntomat0 4y agoMy understanding is that all the memory has to be GPU memory, with proper interconnects. Still not that crazy, all things considered
- lossolo 4y ago> 24x 64 GB nodes is 1.5 TB Looking at your calculations indicates that you mean RAM but it's 1.5 TB GPU VRAM (but this is assuming they use 64 bit precision, which is likely wrong so it's ~750 GB), not RAM.