3 ms·
Fine-Tuning LLMs to 1.58bit
- amilios 2y agoVery exciting, although it was a bit disappointing to see that they're hitting just llama1 7b performance by quantizing llama3. but i'm sure the performance gap will close over time!
- patleeman 2y agoThat's awesome. The original discussion of bitnet made it seem like you needed to train a model from scratch but its neat they were able to adapt an existing model. This is quite exciting.
- cpldcpu 2y agothe performance is still a bit degraded though.