3 ms·
Tail handling is not a problem if you generate custom SIMD code for your particular computation. For example, https://NN-512.com https://NN-512.com (but you ca
by 37ef_ced3 5y ago
Tail handling is not a problem if you generate custom SIMD code for your particular computation.
For example, https://NN-512.com https://NN-512.com (but you can imagine similar code generators for other domains)
Vector overhang (masking), unrolling, full/partial iterations are all known when the code is generated. This allows a very tight fit between the SIMD processor and the work that needs to be done.