3 ms·
> Ceph is designed to host truly massive amounts of data, and generally becomes safer and more performant the more nodes and disks you have to spread your data
by CoolCold 3y ago
> Ceph is designed to host truly massive amounts of data, and generally becomes safer and more performant the more nodes and disks you have to spread your data across.
I'm very pessimistic on CEPH usage in the scenario you have - may be I've missed it, but seen nothing about upgrading networking, as by default you gonna have 1Gbit on single interface used for public network/internal vSwitch.
Even by your benchmarks, write test is 19 iops (block size is huge though)
Max bandwidth (MB/sec): 92
Min bandwidth (MB/sec): 40
Average IOPS: 19
Stddev IOPS: 2.62722
Max IOPS: 23
Min IOPS: 10
while single HDD drive would give ~ 120 iops. single 3 years old NVMe datacenter edition, gives ~ 33000 iops with 4k block + fdatasync=1
CEPH would be very limiting factor in 1Gbit networking I believe - I'd put clear disclaimer on that for fellow sysadmins.
P.S. The amount of work you done is huge and appreciated.