5 ms·
The author may want to consider cuckoo filters over bloom filters. IIRC, there are versions of them that allow for dynamic resizing. Very interesting article.
by vlmutolo 6y ago
The author may want to consider cuckoo filters over bloom filters. IIRC, there are versions of them that allow for dynamic resizing.
Very interesting article. I have to wonder how much benefit a user would get from letting parts of the backup run concurrently with other operations. Aren’t backups usually just run relatively infrequently on a fixed, automated schedule?
- andrewchambers 6y agoCuckoo filters sound interesting, I will definitely investigate further, thanks! > I have to wonder how much benefit a user would get from letting parts of the backup run concurrently with other operations. Aren’t backups usually just run relatively infrequently on a fixed, automated schedule? This is good point, i think it depends a lot on the repository size and storage latency. Some other similar backup tools can take many hours to do a garbage collection on a huge repository, so I'm trying to avoid that if I can. In the end it hasn't been a huge complexity burden and I hope I can keep it that way.
- cat199 6y ago> Aren’t backups usually just run relatively infrequently on a fixed, automated schedule? not familiar with this system, but for large setups, having the maintenance operations block usage can reduce the backup window enough that it impacts your desired scheduling pattern