3 ms·
> You could buy a $150 refurbished 16gb i5 Or I can use the Mac I already have. Your example though, Ouch! ~8B Q4. That's around 5-10 tokens a second. Base M
by EagnaIonat 2mo ago
> You could buy a $150 refurbished 16gb i5
Or I can use the Mac I already have.
Your example though, Ouch!
~8B Q4. That's around 5-10 tokens a second. Base M1 16GB mac would do 15-20 tokens a seconds. That's a 6 year old machine.
You do get what you pay for it seems.
- whatsThisBtn4 1mo agoOh go get a $700 Nvidia laptop. Sorry local models are basically useless outside chat, I didn't even consider it.
- EagnaIonat 1mo agoYou seem to be ill informed and only talking to yourself at this point.