3 ms·
Definitely feels click-bait-y. Ditto for them calling it "Brain Floating Point" [1]. I mean it appears to be a typical floating-point numeric data type with s
by _Nat_ 7y ago
Definitely feels click-bait-y.
Ditto for them calling it "Brain Floating Point" [1]. I mean it appears to be a typical floating-point numeric data type with some of the precision truncated to reduce its cost.
I guess they might be trying to make it sound super-fancy to preempt people seeing it as cheap or/and low-tech?
[1]: https://en.wikipedia.org/wiki/Bfloat16_floating-point_format https://en.wikipedia.org/wiki/Bfloat16_floating-point_format
- exsf0859 7y agoIt's called brain floating point because it was developed by Google's "Google Brain" machine learning project.
- _Nat_ 7y agoYeah, I get the marketing perspective; just, we typically describe primitive data types in terms of what they are from a technical perspective rather than a marketing perspective.
- vlovich123 7y agofp16 & fp8 refer to IEEE 754 floating point which has notable differences from bfloat16 & make them have worse performance for machine learning.
- Traster 7y agoYeah the point is 'reduced precision FP16' would make a lot more sense - since it actually describes what it does. 'Brain' floating point makes you wonder how Neuralink are planning to use this datatype.