4 ms·
Yea, I have run postgres/citus on zfs with petabytes of data. His analysis on record size is lacking. E.g there is a trade-off between compression vs record siz
by testesttest 5y ago
Yea, I have run postgres/citus on zfs with petabytes of data. His analysis on record size is lacking. E.g there is a trade-off between compression vs record size. More compression means more effective iops
- hardwaresofton 5y agoPlease see the reddit discussion -- there's some great feedback there on this very point, and some experienced contacts actually think I didn't go far enough, better results at even more than 16k as long as you can control write amplification and fragmentation. - https://www.reddit.com/r/zfs/comments/rjavyc/everything_ive_seen_on_optimizing_postgres_on_zfs/ https://www.reddit.com/r/zfs/comments/rjavyc/everything_ive_... - https://www.reddit.com/r/zfs/comments/rlfhxb/why_not_txg_timeout1/ https://www.reddit.com/r/zfs/comments/rlfhxb/why_not_txg_tim... - https://www.reddit.com/r/PostgreSQL/comments/rlrvt1/what_happens_if_i_lie_to_to_postgres_about_sync/ https://www.reddit.com/r/PostgreSQL/comments/rlrvt1/what_hap...
- testesttest 5y agoThanks will do! Also, your post would have saved me a bunch of time a few years back. Gj.
- hardwaresofton 5y agoI hope we can lure more of the wizards sitting in their chairs out there to give more talks and write more content in 2022 -- there is so much knowledge on how to run these systems that hasn't been shared yet. I'm spoiled but I want more.