3 ms·
How does that compare with the bf16 version? For my "Please recite Jabberwocky" test the bf16 almost passes but the ternary and even fp8 versions fail badly.
by raylad 9d ago
How does that compare with the bf16 version?
For my "Please recite Jabberwocky" test the bf16 almost passes but the ternary and even fp8 versions fail badly.
- ctolsen 8d agoDefinitely a little better. https://gist.github.com/ctolsen/b2883e7cbf5e4357fa04366019e60bfe https://gist.github.com/ctolsen/b2883e7cbf5e4357fa04366019e6...