4 ms·
I definitely don't think half precision is completely normal obvious type except maybe in certain circles. None of current mainstream languages support it as a
by Sharlin 4y ago
I definitely don't think half precision is completely normal obvious type except maybe in certain circles. None of current mainstream languages support it as a primitive type, for one. No mainstream CPUs have hardware support for half precision.
- wilg 4y agohttps://developer.apple.com/documentation/swift/float16 https://developer.apple.com/documentation/swift/float16 https://scicomp.stackexchange.com/questions/35187/is-half-precision-supported-by-modern-architecture https://scicomp.stackexchange.com/questions/35187/is-half-pr...
- ChrisLomont 4y agoC# supports it. CUDA supports it. ARM and related C/C++ compilers support it. Intel is adding hardware support in upcoming chips, so expect a lot more languages to add it.
- adgjlsfhk1 4y agoJulia also supports it. it led to a really funny graph when doing performance tests on Fujitsu, because Julia is the only language that supports fp16 and is fast enough to write blas in, so there were some graphs where it was the only entry because c and fortran didn't bother showing up.
- TazeTSchnitzel 4y agoMost Intel and AMD CPUs produced in the last ~10 years have hardware support for converting 16-bit floats to and from 32-bit. That's not full hardware support of course, but you don't need it to be able to make good use of them. https://en.wikipedia.org/wiki/F16C https://en.wikipedia.org/wiki/F16C
- Sharlin 4y agoExcept when it comes to SIMD. Having twice the lanes compared to f32 would be a real benefit.