3 ms·

See also: JuiceFS: https://juicefs.com/ https://juicefs.com/ Adds a DBMS or key-value store for metadata, making the filesystem much faster (POSIX, small overw

by remram 4y ago

See also: JuiceFS: https://juicefs.com/ https://juicefs.com/ Adds a DBMS or key-value store for metadata, making the filesystem much faster (POSIX, small overwrites don't have to replace a full object in the GCS/S3 backend). Almost certainly a better solution if you want to turn your object storage into a mountable filesystem, with the (big) caveat that you can't access the files directly in the bucket (they are not stored transparently).

e1g 4y ago
JuiceFS is mostly POSIX compatible, but there are important caveats such as no extended ACL, copying files changes their mtime (impacts backup tools), it offers "close-to-open" consistency (dangerous for log appenders), etc. Choosing an appropriate solution in this space still depends on what you need to do with the storage, and a few other options are MooseFS (https://github.com/moosefs/moosefs https://github.com/moosefs/moosefs) SeaweedFS (https://github.com/seaweedfs/seaweedfs https://github.com/seaweedfs/seaweedfs) Curve (https://github.com/opencurve/curve https://github.com/opencurve/curve) GeeseFS (https://github.com/yandex-cloud/geesefs https://github.com/yandex-cloud/geesefs)
- remram 4y ago
  Those other ones can't use GCS though, which is why I pointed to JuiceFS (at least the ones I recognize).