19 ms·
It's going to be so good to finally have an open source option for large storage building blocks. It's of particular interest to those of us in HPC as if you ar
by gbrown_ 6y ago
It's going to be so good to finally have an open source option for large storage building blocks. It's of particular interest to those of us in HPC as if you are building a large parallel file system and you don't want re-build times to suck your options are basically one of the following.
- IBM's GPFS
- Panasas' PanFS
- Xyratex's -> Seagate's -> Cray's -> HPE's GridRAID in Clusterstor/Sonexion prodcuts
Though ZFS and dRAID will likely show up in that last one in the future.
- deleted 6y ago[deleted]
- p_l 6y agoLustre+ZFS seems to have its fans, and iirc ZFSonLinux was heavily funded by HPC use case
- gbrown_ 6y agoYup in particular Brian Behlendorf from Lawrence Livermore National Laboratory has been a major contributor to ZoL/OpenZFS.
- KaiserPro 6y agoIt makes sense for lustre, as you can remove the hardware raid controller and just use "dumb" jbods. As lustre is mostly a network raid0 (its got better now) it makes sense as you really shouldn't be using it for unreconstructable data.(gross simplification alert)
- throw0101a 6y agoDell-EMC Isilon OneFS
- iforgotpassword 6y agoIt's what we're mainly using currently. Apart from a serious bug after an update that kept crashing nfsd on nodes about two years ago, it has been a very pleasant experience overall. We also use some netapp, but it's a relatively small setup. We tried ceph before, and it seemed to support two modes of operation: Completely broken or rebalancing and thus very slow.
- fh973 6y agoQuobyte DCFS does erasure coding of files across machines (no local RAID needed).