3 ms·

Google uses it on their TPUs [0]. If you're interested in how it would effect the numerical stability of an algorithm you want to use, there is a Julia package

Google uses it on their TPUs [0]. If you're interested in how it would effect the numerical stability of an algorithm you want to use, there is a Julia package that makes prototyping linear algebra over this datatype pretty straightforward [1]. [0] https://cloud.google.com/tpu/docs/system-architecture https://cloud.google.com/tpu/docs/system-architecture [1] https://github.com/JuliaComputing/BFloat16s.jl https://github.com/JuliaComputing/BFloat16s.jl

scottlegrand2 8y ago
And Facebook is taking this even further. And while all these things are very cool, do not let ASIC designers claim they are barriers to entry for GPUs and CPUs. Whatever variants of this precision potpourri catch on are but a generation away from incarnation in general processors IMO... https://code.fb.com/ai-research/floating-point-math/ https://code.fb.com/ai-research/floating-point-math/