4 ms·
7 t/s not sure how you can use this? And if it start thinking a bit. It works yes but that's really very slow. On top it's very low quant that impact the model
by blagui 9d ago
7 t/s not sure how you can use this?
And if it start thinking a bit. It works yes but that's really very slow.
On top it's very low quant that impact the model quality.
- supermatt 9d ago> 7 t/s not sure how you can use this 80 t/s - maybe you need to finish reading a sentence before you comment on it?