2 ms·
It's about a million tokens a week. So you can do the usual calculations of rent Vs buy. There are definitely some tasks, that if the system can run unsuperv
by Lerc 2mo ago
It's about a million tokens a week. So you can do the usual calculations of rent Vs buy.
There are definitely some tasks, that if the system can run unsupervised (a largeish if), it doesn't matter as long as the result happens before a deadline.
In that respect it is easy to tell if this works for you or not. As a stepping stone to more efficiency in the future it has more value.
- danw1979 2mo agoThat’s a good way to think about it - do you want your expensive laptop grinding away constantly 24/7 consuming $5 of power to generate what amounts to $15 worth of tokens per week ? You can get a frontier model subscription for about the same cost as the electricity (heavily subsidised by someone else’s money !) with instant results. I know there are applications for this and it’s cool people are pushing the boundaries with local models. I run oMLX and Qwen myself, but it’s a toy really. It’s not anywhere near replacing Claude for my purposes.
- Wowfunhappy 2mo agoWould it really be $5 of power? I know it's hard to say definitely but even over a week that seems high to me for Apple Silicon. Don't those processors sip power? Probably a useless comparison, but in my NYC studio apartment, my electric bill is usually ~$75 per week during the summer. That includes air conditioning, appliances, etc etc, not to mention the Haswell Desktop PC I keep running 24/7, which is rarely idle because I queue up compile jobs and stuff.