4 ms·
Isn’t that what ZFS is trying to solve? Such that storing a couple billion “ records of a couple Megabytes to Terabytes each” become feasible?
by MichaelZuo 3y ago
Isn’t that what ZFS is trying to solve? Such that storing a couple billion “ records of a couple Megabytes to Terabytes each” become feasible?
- deleted 3y ago[deleted]
- fluoridation 3y agoNo, ZFS tries to solve the problem of data integrity mainly. It also supports very large volumes and files, but it's not particularly good at storing billions of files in a single one. In that respect it's like any other file system. It'll do it, but you need to design your directory structure well to have fast access, and if you try to copy the directory structure it'll still be very slow.
- MarkSweep 3y agoEven in ZFS, there is more overhead for a file than I would guess a database has for a row. Each file needs a DNode, which is 512 bytes. It also needs an entry in it's parent directory's list of files (a 64 byte micro ZAP entry for example).