4 ms·
~13 tokens per second. I asked for a story about goldilocks and this was the timings on my M1 air using `ollama run mistral --verbose`: total duration: 3
by benkaiser 3y ago
~13 tokens per second. I asked for a story about goldilocks and this was the timings on my M1 air using `ollama run mistral --verbose`:
total duration: 33.964492834s
load duration: 1.471584ms
prompt eval count: 8 token(s)
prompt eval duration: 385.334ms
prompt eval rate: 20.76 tokens/s
eval count: 418 token(s)
eval duration: 31.887033s
eval rate: 13.11 tokens/s