3 ms·
It's called brain floating point because it was developed by Google's "Google Brain" machine learning project.
by exsf0859 7y ago
It's called brain floating point because it was developed by Google's "Google Brain" machine learning project.
- _Nat_ 7y agoYeah, I get the marketing perspective; just, we typically describe primitive data types in terms of what they are from a technical perspective rather than a marketing perspective.
- vlovich123 7y agofp16 & fp8 refer to IEEE 754 floating point which has notable differences from bfloat16 & make them have worse performance for machine learning.
- Traster 7y agoYeah the point is 'reduced precision FP16' would make a lot more sense - since it actually describes what it does. 'Brain' floating point makes you wonder how Neuralink are planning to use this datatype.