3 ms·
It would be interesting to try, but probably that wouldn't work as a general-purpose solution. This would require opening all these files at the same time, risk
by pkolaczk 6y ago
It would be interesting to try, but probably that wouldn't work as a general-purpose solution. This would require opening all these files at the same time, risking hitting the open-file number limit. Although the limit could be technically raised, I don't think a user would like to do it only to be able to use the tool. Note we're talking about hundreds thousands or even millions of files here.
- kevincox 6y agoYeah. I would except something to fall over, but it would be interesting to try.
- londons_explore 6y agoBut if the disk is presented with a hundred thousand possible blocks to read next, I suspect it'll find pretty much the perfect option. I doubt a million options will be any better.
- pkolaczk 6y agoBut is the drive's reordering buffer so deep? NCQ in the system reorders only up to 32 requests. I doubt the drive's firmware is capable of reordering millions of requests. These things have typically small amount of memory, just enough for typical use-cases. Keeping a small window for sorting a subset of requests is much weaker than sorting all of them up front. Even if the window is 50% of all files, that would mean the average distance between requests increases 2 times (assuming blocks are distributed uniformly).