Then he must be apoplectic about the new bfloat16 format - only 7 bit mantissa - what the heck It's totally possible that scientists in the future will laugh a

Then he must be apoplectic about the new bfloat16 format - only 7 bit mantissa - what the heck It's totally possible that scientists in the future will laugh at our extremely wide 16-bit neural networks. Computation at the biological synapse level is considered to have an accuracy of 1 to 3 bits only - opinions differ.