msspecter

3 ms·

1. 1.▲
   by msspecter 6y ago

   Then he must be apoplectic about the new bfloat16 format - only 7 bit mantissa - what the heck It's totally possible that scientists in the future will laugh at our extremely wide 16-bit neural networks. Computation at the biological s
2. 2.▲
   by msspecter 6y ago

   https://en.wikipedia.org/wiki/Hilbert_matrix "The Hilbert matrices are canonical examples of ill-conditioned matrices, being notoriously difficult to use in numerical computation."
3. 3.▲
   by msspecter 6y ago

   I have a feeling that Kahan lived in a time where matrix inversion and eigenvalue computation was considered the new hotness, just like neural networks today. It is very easy to build small invertible matrices that cannot be inverted with