3 ms·
Some people do Postgres on compressed ZFS volumes to great success.
by EvanAnderson 9mo ago
Some people do Postgres on compressed ZFS volumes to great success.
- ddtaylor 9mo agoI am curious if you know anyone using Btrfs for this too. I like ZFS, but it Btrfs can do this it would be easier to use with some distros, etc. as it's supported in kernel.
- riku_iki 9mo agoI do it. The big problem for me from running DB on Btrfs is that when I delete large dirs or files (100GB+), it locks disk system, and Db basically stop responding on any queries. I am very surprised that FS which is considered prod grade having this issue..
- jlundberg 9mo agoTry XFS if you havn’t yet. Very solid and no such issues.
- ddtaylor 9mo agoI haven't used XFS in almost two decades, does it have compression support in the same way? Also, does it do JBOD stuff? I know it's a bit of a different thing, but I really enjoy the pool many disks together part of Btrfs, although it has its limitations.
- EvanAnderson 9mo agoXFS doesn't have inline compression, nor does it have volume management functionality. It's a nice filesystem (and it's very fast) but it's just a filesystem.
- riku_iki 9mo agoNo compression.
- olavgg 9mo agoOn average I get around 4x compression on PostgreSQL data with zstd-1
- icefo 9mo agoThat's something I did for small medium size data analysis (300Gb of csv). The reported size was around 800gb with indexes iirc and it fitted on a 512gb SSD. It compresses the indexes pretty well but don't forget to turn off postgres' own copy on write mechanism