4 ms·
Are you sure l? Gains between 10% and 50% are pretty common, but I've never heard of a 100% or greater improvement.
by smabie 6y ago
Are you sure l? Gains between 10% and 50% are pretty common, but I've never heard of a 100% or greater improvement.
- otherjason 6y agoYes, these applications do exist. The speedups mainly come from the more flexible instruction set that AVX-512 provides (so in many cases you can replace several instructions with just one), plus the increased register set (32 architectural SIMD registers versus 16 on previous generations). If your algorithm isn't sensitive to either one of these, then yes, the speedups are often smaller, particularly if the limiting factor in performance is memory bandwidth and/or latency (AVX-512 doesn't help at all there), or if the speedups aren't enough to overcome clock throttling (which IMO is a bit overblown; most people cite the Cloudflare blog article from a few years ago that complained about throttling on Xeon Silver processors, but throttling is much less of an issue on higher-TDP Gold/Platinum CPUs). However, I have seen specific applications that are >100% faster with AVX-512.
- TinkersW 6y agoIf you write SoA code, know what are you doing, and aren't memory bound, 100% speedup isn't unreasonable. Current AVX512 implementations might not always get there, as I believe some instructions are dual issuing at 256bit under the hood.