2 ms·
You seem to go out of your way to avoid mentioning 'index' when that's the usual way to solve this problem.
by fooker 3y ago
You seem to go out of your way to avoid mentioning 'index' when that's the usual way to solve this problem.
- didgetmaster 3y agoApparently, your experience with various indexing services has been different than mine. I found it is just too easy for the index to become 'out of sync' with the actual file system and has to be occasionally rebuilt. Even with just 1M files, that always took a long time; but with 100M+ files?? If the storage was removeable or if you booted occasionally with another OS (or even just a different version of the same OS) then I found it was near impossible for an indexing service to keep track of all the changes.
- fooker 3y agoI was curious how slow it was for 1M files and tried it out on XFS and btrfs partitions. It was basically instant without any explicit indexing on my end.