4 ms·
Yes, if I was going to throw away ten grand on a computer that can run models that are much worse than what I can rent from a variety of providers for a few buc
by SwellJoe 1mo ago
Yes, if I was going to throw away ten grand on a computer that can run models that are much worse than what I can rent from a variety of providers for a few bucks a month, I'd buy the Apple.
- seanmcdirmid 1mo agoWhere are you getting DeepSeek for a few bucks a month? I spend around $3/day on it, sometimes $4.
- SwellJoe 1mo agoI didn't mention DeepSeek, though with the caching effectiveness in Reasonix, you can get DeepSeek for pretty danged cheap directly from deepseek.com, even at the higher prices. I was referring to the many subscriptions available that will sell you quite a lot of usage for $20/month. Given how slow local inference is, you're probably not going to ever get your money back out of it if you just use it for inference (or training/fine-tuning, since you can rent GPUs for a buck or two an hour and ten grand is a lot of hours). When memory prices come back down, I'll be down to the Apple Store. But, it doesn't make sense to buy hardware right now.
- seanmcdirmid 1mo agoI don't think the $20/month packages come with API access at all. I bought a refurbished M3 Max a couple of years ago just to try things out, I get 90 toks/s which is good enough for a lot of tasks. But ya, when DRAM prices come back down I'll definitely look for a better local rig.
- SwellJoe 1mo agoThe Qwen and Z.ai coding plans include API access, last I checked. OpenCode Go also has API access to a bunch of models for $10/month.