3 ms·
Would be interested to see a comparison with other not-NFS things (Lustre, daos, etc). User space filesystem is not the first thing that comes to my mind when
by dmoy 1y ago
Would be interested to see a comparison with other not-NFS things (Lustre, daos, etc).
User space filesystem is not the first thing that comes to my mind when trying to get faster performance than NFS
- agcat 1y agoThis is a great idea
- bayindirh 1y agoYou could also try JuiceFS & Weka (if you can have access to a cluster). A well configured and distributed Lustre will be very fast, BTW. JuiceFS: https://juicefs.com/en/ https://juicefs.com/en/ Weka: https://www.weka.io/ https://www.weka.io/
- nickaggarwal 1y agoWill test out Weka, Thanks for sharing
- fh973 1y agoAt Quobyte (https://www.quobyte.com https://www.quobyte.com) we use FUSE for the client for parallel file system access. You can get dozens of GB/s out of FUSE nowadays. This will even improve in the near future as FUSE is adding io_uring support for communication with the kernel (instead of a pipe).
- dmoy 1y agoYea I don't doubt that FUSE can go past NFS But, as sibling is pointing out, e.g. Amazon fsx Lustre throughput is like 1GB/s throughout per TB storage, so presumably hundreds of GB/s at scale.
- nickaggarwal 1y agoYes there is AWS FSx with lustre in the blog..that might be worth checking out