3 ms·
Hm, why is NVidia only talking about FP16 in regards to the new transformer blocks. Isn't BFloat16 better in most cases?
by lostmsu 5y ago
Hm, why is NVidia only talking about FP16 in regards to the new transformer blocks. Isn't BFloat16 better in most cases?