3 ms·
"What are the limits of ZFS, can it scale up to the petabyte range like Ceph?" We (rsync.net) have scaled zpools to petabyte range. A current, example configu
by rsync 6y ago
"What are the limits of ZFS, can it scale up to the petabyte range like Ceph?"
We (rsync.net) have scaled zpools to petabyte range.
A current, example configuration would be:
- 60-drive JBODs
- 15 drive raidz3 vdevs, four per JBOD
- 16TB SAS drives
That ends up being ~192TB per vdev, 768 TB per JBOD ... and if you span a pool across two JBODs, you have ~1.5 PB.
I should note that what makes it possible to sleep at night with such a configuration is the fact that raidz3 exists. If not for that, I would not configure 15 drive vdevs with jut raidz2 ("raid6") protection.
- tutfbhuf 6y agoHas rsync.net ever considered Ceph and if yes, why decided against it in favour of ZFS?
- rsync 6y agoNo, we did not ever consider ceph. rsync.net architecture is purely FreeBSD and there was just a very good fit - and roadmap - from UFS2 which we used from 2001-2012 and ZFS which we have used since. Also, for better or worse, rsync.net is about UNIX and ZFS is very unixy. We think in filesystems and files and directories and ZFS let's us keep that set of abstractions.