3 ms·
Im on an m1 Mac book air 2020: Mistral: "Hi there! How can I assist you today?" total duration: 2.811067333s load duration: 4.093083ms prompt eva
by benengel 3y ago
Im on an m1 Mac book air 2020:
Mistral: "Hi there! How can I assist you today?"
total duration: 2.811067333s
load duration: 4.093083ms
prompt eval count: 9 token(s)
prompt eval duration: 1.999431s
prompt eval rate: 4.50 tokens/s
eval count: 10 token(s)
eval duration: 758.398ms
eval rate: 13.19 tokens/s
its pretty dang fast.