4 ms·
Litestream author here. The motivation for this docs page was two-fold. First, laying out the different options with their trade-offs helps people understand wh
by benbjohnson 4y ago
Litestream author here. The motivation for this docs page was two-fold. First, laying out the different options with their trade-offs helps people understand what Litestream is trying to be so it helps keep my focus narrow. For example, if someone is looking for very high durability guarantees then they can see that rqlite might be a better fit and they don't try to fit Litestream into that mold.
Second, Litestream doesn't interfere with other backup methods so you can run it alongside a cron-based backup. I typically run both because I'm overly paranoid and because it's cheap.
- mattl 4y agocrontab isn’t a tool, cron is the tool. It reads a little strange because of that.
- benbjohnson 4y agoGood call. I updated the docs repo and the site should update in a few minutes.
- mattl 4y agoAwesome!
- ctur 4y agoNice post — one suggestion would be to use zstd instead of gzip though. Out of the box it is much faster and will result in smaller files, and allows tuning to fit inside memory and cpu thresholds different use cases might prefer. Friends don’t let friends use gzip :)
- otterley 4y agoStorage is so cheap nowadays that usability and compression speed are more important for most people.
- usefulcat 4y agoFor a given compression ratio, zstd compression is faster than gzip by a good margin (even without using multiple threads). And zstd decompression is pretty much always faster than gzip too.
- jrockway 4y agoHere is a nice page for mapping "what first came to mind" to "what's actually fastest in 2021": https://jolynch.github.io/posts/use_fast_data_algorithms/ https://jolynch.github.io/posts/use_fast_data_algorithms/ TL;DR, lz4 is 10x faster than gzip (though does not produce as small as a file), zstd is twice as fast and better.
- benbjohnson 4y agoThanks, I thought about using a different compression tool but everybody knows gzip so I figured I’d keep it simple. Litestream uses LZ4 internally (which is great) but it’s not something a lot of developers come across too often.
- wheels 4y agoI'm not saying that's the logic here, but this is a common pattern because SEO. It's a useful way to end up on potential customers' radar.