3 ms·
When you step back, it's kind of absurd that a 1B model can achieve this eval score. Makes me very excited about the future of on-device inference.
by armeet 10mo ago
When you step back, it's kind of absurd that a 1B model can achieve this eval score. Makes me very excited about the future of on-device inference.
- necovek 10mo agoIt kind of is expected, right? If a 70B model can have great overall performance, a 1B model focused on coding and a single language could even be comparable. I am actually hoping we see more per language models soon, though obviously, it can be as "smart" if trained only on a single language.