5 ms·
Why should a filesystem care about NVMe? Because at some point the filesystem becomes a bottleneck. ZFS was designed with the assumption that CPUs would be way
by chongli 9y ago
Why should a filesystem care about NVMe?
Because at some point the filesystem becomes a bottleneck. ZFS was designed with the assumption that CPUs would be way faster than storage. When you get speeds over 10GB/sec, [0] you are going to spend a lot of time checksumming all that data.
[0] http://www.seagate.com/ca/en/about-seagate/news/seagate-demonstrates-fastest-ever-ssd-flash-drive-pr/ http://www.seagate.com/ca/en/about-seagate/news/seagate-demo...
- wmf 9y agoWhat could ZFS do differently to solve that problem while maintaining data integrity?
- loeg 9y agoJust one idea: offload checksum calculation to a DMA engine. Linux already has a generic DMA engine facility in the kernel, backed by e.g. I/OAT on some Intel hardware.
- boomboomsubban 9y agoAssuming this is the same thing as hardware-assisted checksums, both the ZFS on Linux maintainer and Intel have said that they are working on it at various cons last year.
- olavgg 9y agoFletcher checksums are very cheap and not a bottleneck. https://github.com/zfsonlinux/zfs/issues/4789#issuecomment-230764245 https://github.com/zfsonlinux/zfs/issues/4789#issuecomment-2...
- chongli 9y agoMaybe I'm reading those benchmarks wrong, but they appear to max out well under 10GB/s. This would mean you'd be CPU bound on your checksums alone with one of those Seagate cards.
- olavgg 9y agoThat is a Xeon Phi, a modern Xeon with 10+ cores should do tens of GB/s https://cloud.githubusercontent.com/assets/472018/13333262/fff39076-dbba-11e5-9d24-55d93d018567.png https://cloud.githubusercontent.com/assets/472018/13333262/f... https://github.com/zfsonlinux/zfs/pull/4330 https://github.com/zfsonlinux/zfs/pull/4330
- dev_tty01 9y agoHmm, I for one don't want to tie up ten cores with IO.
- ioquatix 9y agoIf you aren't checksumming your data, is it truely your data?
- blattimwind 9y ago> Hmm, I for one don't want to tie up ten cores with IO. What else are you going to use the two CPUs in a filer for?
- 9y ago