5 ms·
At my previous company we made heavy use of its lossy compression feature.
by byefruit 9y ago
At my previous company we made heavy use of its lossy compression feature.
- deleted 9y ago[deleted]
- X86BSD 9y agoYou would get compression with Postgres running on ZFS.
- kinghajj 9y agoLossy compression, not lossless.
- crypto5 9y agoIn random cloud provider you may not get FS with compression on your machine..
- sqeaky 9y agoDatabase plus Copy-On-Write file systems sound like a bad idea. I am imagining a modest 100gb database being re-written for every change. I am sure there is some way to work around this, but wouldn't this be the default behavior with a typical database and typical COW file system?
- X86BSD 9y agoYou might be interested in reading this paper: https://people.freebsd.org/~seanc/postgresql/scale15x-2017-postgresql_zfs_best_practices.pdf https://people.freebsd.org/~seanc/postgresql/scale15x-2017-p...
- sqeaky 9y agoI am interested and I appreciate the thought and link, however these appear to be the slides to a talk without the actual talk. If so they are of limited use because the slides never have all the information the presenter has, and that information is often just a summary. Is this the correct talk: https://youtu.be/dwMQXLOXUco?t=5380 https://youtu.be/dwMQXLOXUco?t=5380 ?
- X86BSD 9y agoYes, sorry about that, that is the corresponding talk to the slides. Thanks for pointing that out.
- cryptonector 9y agoFirst, you have to make sure the page sizes for the FS and DB match. That's a critical requirement. But yes, you'll get write expansion twice.
- adamzochowski 9y agoPostgresql has compression by default on, for all large text and other large fields that get great benefit of compression. From documentation -" The technique is affectionately known as TOAST (or "the best thing since sliced bread"). "- https://www.postgresql.org/docs/8.0/static/storage-toast.html https://www.postgresql.org/docs/8.0/static/storage-toast.htm...
- pkhagah 9y agoWhat lossy compression? Were you guys throwing bits into /dev/null?
- infogulch 9y agoIs that related to the cool "hash compression" technology I hear about? Apparently it can compress an arbitrarily large file into just a few bytes, amazing!