4 ms·
We use it in gemma.cpp [1]. This hybrid of E5M2 and E4M3 decodes to bf16 in ~14 instructions, so we can do that on the fly during dot products. [1]: github.com
by janwas 3y ago
We use it in gemma.cpp [1]. This hybrid of E5M2 and E4M3 decodes to bf16 in ~14 instructions, so we can do that on the fly during dot products.
[1]: github.com/google/gemma.cpp
- danielhanchen 3y agoCongratulations on gemma.cpp!!