3 ms·
If it is an instruction thing and not more of a separate coprocessor, it is maybe SIMD on smaller integers for inference (like how AVX512 enables vectorized 8bi
by cma 6y ago
If it is an instruction thing and not more of a separate coprocessor, it is maybe SIMD on smaller integers for inference (like how AVX512 enables vectorized 8bit integer math, for 64 operations per instruction).