3 ms·
The lack of a token rate metric for the kimi example is disappointing.
by abtinf 7mo ago
The lack of a token rate metric for the kimi example is disappointing.
- zozbot234 7mo agoThe latter link says they get ~1.7 tok/s which is quite impressive for a near-SOTA local model running on ordinary hardware.