2 ms·
fair, i think i was referring more to 1.58 bit architecture in general since the original paper (Figure 3) shows that we eliminate FP16 multiplication and addit
by c0rruptbytes 4mo ago
fair, i think i was referring more to 1.58 bit architecture in general since the original paper (Figure 3) shows that we eliminate FP16 multiplication and addition just for INT8 addition. I need to dive deeper into bonsai overall if it differs
https://arxiv.org/pdf/2402.17764 https://arxiv.org/pdf/2402.17764