5 ms·

Block cloning is kind of a significant update! I wonder what holds back a ZFS-level offline dedupe function now that that's implemented since you could already

by XorNot 3y ago

Block cloning is kind of a significant update! I wonder what holds back a ZFS-level offline dedupe function now that that's implemented since you could already basically write a shell script to do something like it.

simcop2387 3y ago
Might be easy to extende fdupes and jdupes to be able to do this without much effort. I haven't seen the api/syscall invokved but I use them with btrfs for a specific use where I have a lot of known duplicates.
binarycrusader 3y ago
For filesystem geeks (of a sort) like myself, note that ReFS has had block cloning support for some time now: https://learn.microsoft.com/en-us/windows-server/storage/refs/block-cloning https://learn.microsoft.com/en-us/windows-server/storage/ref...
- pseudalopex 3y ago
  ReFS had many problems though.[1] Are they better now? [1] https://www.reddit.com/r/DataHoarder/comments/iow60w/testing_windows_refs_data_integrity_bit_rot/ https://www.reddit.com/r/DataHoarder/comments/iow60w/testing...
  - ago 3y ago
    I tried it a few months ago and ReFS ate my data. No indication of why in event logs or SMART data. It had IsPowerProtected set because I have a UPS and I had a unclean restart, I would expect it to lose data, but not to corrupt the filesystem metadata. I had a backup of the data but wanted some recent changes. Refsutil (the official Microsoft tool) didn't help because it has not been updated for the newest ReFS version. I couldn't read most files because I had integrity enable and files failed the check. Hetman's Data Recovery was able to recover most of the data. In later testing I found out that IsPowerProtected is just very unsafe. I have since put some time into testing and sometimes fixing https://github.com/openzfsonwindows/openzfs https://github.com/openzfsonwindows/openzfs , it is not ready for use yet, but it is making great progress.

by XorNot 3y ago

simcop2387 3y ago

Might be easy to extende fdupes and jdupes to be able to do this without much effort. I haven't seen the api/syscall invokved but I use them with btrfs for a specific use where I have a lot of known duplicates.

binarycrusader 3y ago

For filesystem geeks (of a sort) like myself, note that ReFS has had block cloning support for some time now: https://learn.microsoft.com/en-us/windows-server/storage/refs/block-cloning https://learn.microsoft.com/en-us/windows-server/storage/ref...

pseudalopex 3y ago
ReFS had many problems though.[1] Are they better now? [1] https://www.reddit.com/r/DataHoarder/comments/iow60w/testing_windows_refs_data_integrity_bit_rot/ https://www.reddit.com/r/DataHoarder/comments/iow60w/testing...
- ago 3y ago
  I tried it a few months ago and ReFS ate my data. No indication of why in event logs or SMART data. It had IsPowerProtected set because I have a UPS and I had a unclean restart, I would expect it to lose data, but not to corrupt the filesystem metadata. I had a backup of the data but wanted some recent changes. Refsutil (the official Microsoft tool) didn't help because it has not been updated for the newest ReFS version. I couldn't read most files because I had integrity enable and files failed the check. Hetman's Data Recovery was able to recover most of the data. In later testing I found out that IsPowerProtected is just very unsafe. I have since put some time into testing and sometimes fixing https://github.com/openzfsonwindows/openzfs https://github.com/openzfsonwindows/openzfs , it is not ready for use yet, but it is making great progress.