3 ms·
As a sorta-kinda testimonial, Concourse just released a version[0] that switches its volume streaming compression from gzip to zstd. It consumed so much less CP
by jacques_chester 7y ago
As a sorta-kinda testimonial, Concourse just released a version[0] that switches its volume streaming compression from gzip to zstd. It consumed so much less CPU that they were also able to introduce parallel streaming.
On a test workload which slings around many large volumes these changes made it approximately 20x faster[1].
[0] https://github.com/concourse/concourse/releases/tag/v5.4.0 https://github.com/concourse/concourse/releases/tag/v5.4.0
[1] https://github.com/concourse/concourse/issues/3992#issuecomment-504036411 https://github.com/concourse/concourse/issues/3992#issuecomm...