2 ms·
That looks really good. A 3.8B model holding it's own against pretty 7B class models is definitely an accomplishment. Sizing looks like it is aimed primarily a
by Havoc 2y ago
That looks really good. A 3.8B model holding it's own against pretty 7B class models is definitely an accomplishment.
Sizing looks like it is aimed primarily at copilot style NPUs I guess
- jarbus 2y agoI'm all for NPU-capable AI personally. Very excited to run competitive models locally and offline.