2 ms·
With FP16 you can fit twice as much weights in cache, and also fetch twice as much weights from memory Also this depends on the size of the matrix
by nextaccountic 3y ago
With FP16 you can fit twice as much weights in cache, and also fetch twice as much weights from memory
Also this depends on the size of the matrix