3 ms·

I ran the 26B model on my i5 which has no discrete graphics card. It ran about 7 tokens/sec, and appreared to be a very capable model.

• madduci 4mo ago
  Interesting, thanks for the feedback!
• madduci 4mo ago
  I've tested the e4B with the iGPU and it works incredibly good locally. I'll try this model as soon as it is available on ollama