3 ms·
The demo they showed was full of repeated sentences. The 3B model looks quite dense, TBH. Did they just want to show the speed?
by sinuhe69 2y ago
The demo they showed was full of repeated sentences. The 3B model looks quite dense, TBH. Did they just want to show the speed?
- newswasboring 2y ago3B models, especially in quantized state, almost always behave like this.