3 ms·

Is there any good tooling on managing automatic snapshotting and sending backups?

ptomato 5y ago
sanoid (https://github.com/jimsalterjrs/sanoid/ https://github.com/jimsalterjrs/sanoid/) is probably the most featureful, but there's quite a few I'm aware of - zfsnap, zfs-auto-snapshot, zfs_autobackup, znapzend...
indiv0 5y ago
Personally I just setup sanoid and syncoid on my NAS. They were dead simple to get up and running with. Sanoid makes snapshots according to a schedule you define (e.g. 1 monthly, 31 daily, 24 hourly). It also prunes old snapshots to ensure that you always have the exact snapshots you need available and no more. Syncoid uses zfs send/recv to copy over snapshots from one ZFS dataset to another, typically between machines. You basically have two options: either you can: 1) copy over ALL of the snapshots from the source in the order they were created (like cherry picking one git commit after another onto another branch), or you can: 2) configure it to make a new snapshot every time it syncs and just copy over the diff since the last time you synced (a bit like squashing all the commits into one and just cherry-picking that). The former is good if you want to maintain the same snapshots on the source and the destination (you can also use sanoid on the destination to prune the snapshots further). The latter is good if you want to minimize the amount of churn sent over the network. For example if you're snapshotting VM images you'd be interested in sending over the state of the VM as it appears at the end of the day, rather than all the intermediate state.
waz0wski 5y ago
sanoid is a good one. I've been on a quest to run mostly golang-based utilities and switched to https://github.com/zrepl/zrepl https://github.com/zrepl/zrepl which has been running/syncing without issue for a couple years now
unixhero 5y ago
Proxmox backup node https://www.proxmox.com/en/proxmox-backup-server https://www.proxmox.com/en/proxmox-backup-server
fmx 5y ago
zfs-auto-snapshot is a simple one that does what I need. I run it from cron to: - take snapshots hourly and daily - prune old snapshots (--keep option) - send the snapshot to a remote host (--post-snapshot=zfs send ...)

sanoid (https://github.com/jimsalterjrs/sanoid/ https://github.com/jimsalterjrs/sanoid/) is probably the most featureful, but there's quite a few I'm aware of - zfsnap, zfs-auto-snapshot, zfs_autobackup, znapzend...

indiv0 5y ago

Personally I just setup sanoid and syncoid on my NAS. They were dead simple to get up and running with. Sanoid makes snapshots according to a schedule you define (e.g. 1 monthly, 31 daily, 24 hourly). It also prunes old snapshots to ensure that you always have the exact snapshots you need available and no more. Syncoid uses zfs send/recv to copy over snapshots from one ZFS dataset to another, typically between machines. You basically have two options: either you can: 1) copy over ALL of the snapshots from the source in the order they were created (like cherry picking one git commit after another onto another branch), or you can: 2) configure it to make a new snapshot every time it syncs and just copy over the diff since the last time you synced (a bit like squashing all the commits into one and just cherry-picking that). The former is good if you want to maintain the same snapshots on the source and the destination (you can also use sanoid on the destination to prune the snapshots further). The latter is good if you want to minimize the amount of churn sent over the network. For example if you're snapshotting VM images you'd be interested in sending over the state of the VM as it appears at the end of the day, rather than all the intermediate state.

waz0wski 5y ago

sanoid is a good one. I've been on a quest to run mostly golang-based utilities and switched to https://github.com/zrepl/zrepl https://github.com/zrepl/zrepl which has been running/syncing without issue for a couple years now

unixhero 5y ago

Proxmox backup node https://www.proxmox.com/en/proxmox-backup-server https://www.proxmox.com/en/proxmox-backup-server

fmx 5y ago

zfs-auto-snapshot is a simple one that does what I need. I run it from cron to: - take snapshots hourly and daily - prune old snapshots (--keep option) - send the snapshot to a remote host (--post-snapshot=zfs send ...)