3 ms·

It is not a flaw in the ZFS data model, it is a carefully considered tradeoff between consistency and IOPS for RAIDZ. The real world I a cruel place and you get

It is not a flaw in the ZFS data model, it is a carefully considered tradeoff between consistency and IOPS for RAIDZ. The real world I a cruel place and you get nothing for free, in order to have distributed parity and consistency you will have to suffer the lowest common denominator IOPS penalty. That is just maths. If you want to use ZFS and have more IOPS you will have to have more VDEVs (either more RAIDZs or several mirrors). Your storage efficiency will be slightly reduced (RAIDZ) or tank to 50% (mirrors) with less redundancy. But to call it a flaw in the data model goes a long way to show that you do not appreciate (or understand) the tradeoffs in the design.

Dylan16807 5y ago
> It is not a flaw in the ZFS data model, it is a carefully considered tradeoff between consistency and IOPS for RAIDZ. You could have both! That's not the tradeoff here. The problem is that if you wrote 4 independent pieces of data at the same time, sharing parity, then if you deleted some of them you wouldn't be able to recover any disk space. > That is just maths. I don't think so. What's your calculation here? The math says you need to do N writes at a time. It doesn't say you need to turn 1 write into N writes. If my block size is 128KB, then splitting that into 4+1 32KB pieces will mean I have the same IOPS as a single disk. If my block size is 128KB, then doing 4 writes at once, 4+1 128KB pieces, means I could have much more IOPS than a single disk. And nothing about that causes a write hole. Handle the metadata the same way. ZFS can't do that, but a filesystem could safely do it. > But to call it a flaw in the data model goes a long way to show that you do not appreciate (or understand) the tradeoffs in the design. The flaw I'm talking about is that Block Pointer Rewrite™ never got added. Which prevents a lot of use cases. It has nothing to do with preserving consistency (except that more code means more bugs).

Dylan16807 5y ago

> It is not a flaw in the ZFS data model, it is a carefully considered tradeoff between consistency and IOPS for RAIDZ. You could have both! That's not the tradeoff here. The problem is that if you wrote 4 independent pieces of data at the same time, sharing parity, then if you deleted some of them you wouldn't be able to recover any disk space. > That is just maths. I don't think so. What's your calculation here? The math says you need to do N writes at a time. It doesn't say you need to turn 1 write into N writes. If my block size is 128KB, then splitting that into 4+1 32KB pieces will mean I have the same IOPS as a single disk. If my block size is 128KB, then doing 4 writes at once, 4+1 128KB pieces, means I could have much more IOPS than a single disk. And nothing about that causes a write hole. Handle the metadata the same way. ZFS can't do that, but a filesystem could safely do it. > But to call it a flaw in the data model goes a long way to show that you do not appreciate (or understand) the tradeoffs in the design. The flaw I'm talking about is that Block Pointer Rewrite™ never got added. Which prevents a lot of use cases. It has nothing to do with preserving consistency (except that more code means more bugs).