3 ms·
Do you know how many tokens per second you are getting? I have a similar laptop that I can test on later but if you have that info handy let me know!
by jhickok 2y ago
Do you know how many tokens per second you are getting? I have a similar laptop that I can test on later but if you have that info handy let me know!
- snickell 2y agoM2 max with 64GB: 14 tokens/s running `ollama run mistral-small:24b --verbose`