2 ms·
On a modern linux server the kernel caches files aggressively. As an example, we have a server that can saturate 40 cores of CPU during load if fed data quickl
by vessenes 10y ago
On a modern linux server the kernel caches files aggressively.
As an example, we have a server that can saturate 40 cores of CPU during load if fed data quickly enough. On the first load after cold boot, it takes about 2 minutes to run (fed by SSDs). Second boot, about 30 seconds.
If we run a sequential data load off SSD, it's more like 8 minutes on the cold run. So, even off non-RAM storage, parallel reads can help a lot.
- TomHubelbauer 10y agoI didn't know that, thanks for sharing! It's really interesting and might come in handy to know this.