4 ms·
> Does my data fit in RAM? 1. If you have to ask, then either it doesn't now, or it doesn't sometimes. So assume it doesn't. 2. If you can use a cluster, then
by einpoklum 7y ago
> Does my data fit in RAM?
1. If you have to ask, then either it doesn't now, or it doesn't sometimes. So assume it doesn't.
2. If you can use a cluster, then maybe.
3. In some senses, it doesn't matter. How so? Reading and writing from RAM is very slow, latency-wise, for today's processors. If I can bend the truth a little, it's a bit like a fast SSD. So, if you can up the bandwidth to disk enough, it becomes kind of comparable. Well, if you can use 16 PCIe 4.0 lanes, it's roughly 24 GB/sec effective bandwidth, which is roughly half of your memory bandwidth. Now it's true that in real-life systems it's usually just 4 lanes, but it's very doable to change that with a nice card.
4. DIMM-form-factor non-volatile memory may increase memory sizes much more.