4 ms·
A realistic speedup to expect from vectorization is probably closer to 10x. Other overheads start to dominate once you've optimized your inner loops. It's also
by sagarm 6y ago
A realistic speedup to expect from vectorization is probably closer to 10x. Other overheads start to dominate once you've optimized your inner loops.
It's also not reasonable to expect to vectorize everything; for example a web server is unlikely to benefit from vectorization.
- kragen 6y agoJust to clarify, I was only estimating a speedup of 4× from vectorization, while the other 8× comes from multithreading. Fifteen years ago we thought regular expression matching and compilers were unlikely to benefit from vectorization, but now we have Hyperscan and Co-dfns, so they did. So I think it's likely that we will figure out ways to do a wider variety of computations in vectorized ways, now that the rewards are so great.