3 ms·
Curious if something like Ceph would help.
by j45 3y ago
Curious if something like Ceph would help.
- magicalhippo 3y agoAt a massive performance cost.
- j45 3y agoPerformance isn’t the only requirement in storage. Are there any other options worth looking at? Thanks!
- Fnoord 3y agoClustering filesystems are old. RedHat at some point took over the company behind GFS perhaps worth looking into. I've also seen people in edge computing space go for Longhorn instead of Ceph. But I don't know anything about it apart that Ceph is available in Proxmox. My homelab with Turing Pi 2 is running RPi4 CM and an Nvidia Jetson. Each also have a small SSD (one native, two miniPCI to SATA, and one USB). They could be used with k8s or a clustering filesystem but haven't played with it as of yet.
- KaiserPro 3y agoceph is never the answer. Its a nice idea, but in practice its just not that useful. if you want speed: lustre if you want anything else: gpfs.
- j45 3y agoAppreciate the options to check out.
- throw0101c 3y ago> ceph is never the answer. Its a nice idea, but in practice its just not that useful. Depends. At my last job we used it for our OpenStack block/object store and it was performant enough. When we started it was HDD+SSD, but after a while (when I left) the plan was to go all-NVMe (once BlueStore became a thing).
- j45 3y agoSacrificing 10-30% of performance for other things that might be useful might be well worth it.
- magicalhippo 3y agoMy understanding after reading and testing is that we're talking at least two orders of magnitude difference unless you have a lot of disks (certainly more than the 6 I tried with) and quite beefy hardware. Haven't tried all-SSD cluster yet though, only spinning rust.
- throw0101c 3y agoOur OpenStack storage back-end at about ten+ storage servers, each with (IIRC) dozen+ disks eacho.