5 ms·

Yeah, bitnets already shift those matmuls to integer math.

• smolder 2y ago
  Thanks for turning me on to this subject. It's interesting. I took a look at this paper: https://arxiv.org/abs/2310.11453 https://arxiv.org/abs/2310.11453
  • ericd 2y ago
    No problem, glad you found it interesting, I think it's pretty exciting stuff. This is a more recent paper by the same people, where they tweak slightly to ternary (-1, 0, 1), and they seem to be able to maintain network performance: https://arxiv.org/pdf/2402.17764 https://arxiv.org/pdf/2402.17764