3 ms·
"so in summary, don’t use filesystems for large distributed systems." Don't use a _normal_ filesystem for large distributed systems. Being able to seek() on a
by KaiserPro 8y ago
"so in summary, don’t use filesystems for large distributed systems."
Don't use a _normal_ filesystem for large distributed systems.
Being able to seek() on a file (without having to download it first) is something that is very underrated these days
just like databases, clustered filesystems also conform to CAP. You need to pick which part of the triangle you need.
I really like GPFS, as it has lots and lots of hooks (like S3) for events. It also has "HSM" which allows you to optimise which part of CAP you want based on arbitrary parameters (for example I've seen a rule that was if the file was an image, larger than 1000pixels and red, put it on long term storage.)
- zokier 8y ago> just like databases, clustered filesystems also conform to CAP Instead of being like databases, I like to think filesystems (clustered or not) as one type of database. Of course that is just more of a mental trick rather than any deep insight to anything.