3 ms·
Good grief. Talk of rsync backups on live DB systems. zfs. On the fly disk encryprion. All I can think of is, clearly these guys never worked with spinning
by b112 5y ago
Good grief.
Talk of rsync backups on live DB systems. zfs. On the fly disk encryprion.
All I can think of is, clearly these guys never worked with spinning disks and large datasets.
So much headroom to waste with SSDs, people are spoiled today.
- laumars 5y agoNothing you’ve described there wasn’t possible with spinning disks storing large data sets. In fact if anything, ZFS is ideally suited to exactly that scenario.
- b112 5y agoI assure you, rsync can tank a highly tuned db environment. 'updatedb', which updates the db 'locate' uses under linux, running in its cron, can cause issues. It all depends upon how much headroom you have, the type of io activity, etc. I've operated systems under consistent 80% io load with massive datasets at the time, under spinning disks. Running rsync would be madness on such a system. I know. I only did it once.
- whitepoplar 5y agoThey never said they were using rsync on their datasets. They're likely using ZFS snapshots.
- ComodoHacker 5y agoLet me guess, your system hadn't ionice back then?
- b112 5y agoionice works only on some elevators, and worked on fewer a decade ago. As well, ionice doesn't help with this degree of load.
- deleted 5y ago[deleted]
- laumars 5y agoThe article specifically said they were doing snapshots because you cannot rsync on live datasets. They’re doing it correctly and would still be doing it correctly if they were on spinning disks. ZFS is designed exactly for these types of operations.
- netizen-936824 5y agoI'm not sure I understand your comment. Is this extra headroom a bad thing?
- b112 5y agoMore of a jealous thing, and, astonishment at how much extra hardware is used to give that headroom. Over the years, I've run comparatively larger datasets, on significantly less hardware. edit: When I switched to SSDs for the first time, to give you a performance example, on some read queries I saw a 1000x to 10000x speed improvement. This of course was on a read only secondary, long running reporting queries, no one runs queries of that nature on a primary. SSD were an insane game changer.
- terr-dav 5y agoI think you're feeling envy, not jealousy. ;]