3 ms·
That’s a good way to think about it - do you want your expensive laptop grinding away constantly 24/7 consuming $5 of power to generate what amounts to $15 wort
by danw1979 2mo ago
That’s a good way to think about it - do you want your expensive laptop grinding away constantly 24/7 consuming $5 of power to generate what amounts to $15 worth of tokens per week ?
You can get a frontier model subscription for about the same cost as the electricity (heavily subsidised by someone else’s money !) with instant results.
I know there are applications for this and it’s cool people are pushing the boundaries with local models. I run oMLX and Qwen myself, but it’s a toy really. It’s not anywhere near replacing Claude for my purposes.
- Wowfunhappy 2mo agoWould it really be $5 of power? I know it's hard to say definitely but even over a week that seems high to me for Apple Silicon. Don't those processors sip power? Probably a useless comparison, but in my NYC studio apartment, my electric bill is usually ~$75 per week during the summer. That includes air conditioning, appliances, etc etc, not to mention the Haswell Desktop PC I keep running 24/7, which is rarely idle because I queue up compile jobs and stuff.