4 ms·
But why give Anthropic/openai our money? Nonsense. Use open models
by sdevonoes 6mo ago
But why give Anthropic/openai our money? Nonsense. Use open models
- theshrike79 6mo agoThe author got $50 free credits. Also Anthropic is by far the best, open (local) models are glorified autocomplete at best unless you casually have 20k€ worth of hardware at home.
- eikenberry 6mo agoWhy assume local when you can easily use any of the open models via openrouter or any number of similar services.
- theshrike79 6mo agoThe OP said “ But why give Anthropic/openai our money? Nonsense. Use open models” Then I’d be giving money to openrouter and a Chinese model provider, is that better?
- eikenberry 6mo agoYes, it is better. They are releasing open models, unlike Anthropic. Additionally other (non-chinese) companies run the open models, so if that is the issue you have options.
- signatoremo 6mo ago"If you don't pay for a product, you are the product". That's always been emphasized on HN threads related to FB, Google, etc. Are LLMs different?
- eikenberry 5mo agoThis is more a form of commoditizing your compliment as they don't see the model as a product but more like a programming language or other tool that you build products with.
- binary0010 6mo agoDisagree. Qwen 3.6 and opencode have built and helped plan entire feature sets such as vectorizing and searching, setting up UI to manage categorized search data. Some test systems around this, etc. Very usable locally assuming you setup your local tooling correctly and you are an actual programmer who can generally help drive this stuff correctly and not just a vibe coder.
- theshrike79 6mo agoHow big of a Qwen model are you running that can plan and implement entire feature sets? I’ve tried multiple that I can run locally and they’re all very much just glorified autocomplete, but slower - on a M4 Max MacBook
- binary0010 6mo agoI'm running qwen 3.6 35b. I'm using opencode here's one of the projects I've had it complete - just so you know exactly what it's getting done. I have a large (300,000k loc) sims-like game that I've hand written over last 3 years. I have a lot of internal administration tooling that has to be built to manage stuff like icons, NPC brain data, world lore, world actions, all kinds of 3d game data, etc, etc. One example I had qwen do: Work with me to plan out a feature for an admin panel to manage searchable vector embeddings for each NPC's personality, this was around 600 loc across 4 files, back-end database, front-end UI logic, and front-end templating. It made 3 small mistakes I told it to sort out and fix, which it did. I essentially let it do it's thing while I was working on main game core coding. So I was pretty hands off and it planned things out nicely before-hand and got my approvals before it built it. I really wouldn't call it "glorified auto complete"
- theshrike79 5mo agoThanks, I really need to try that today - although with pi.dev =) I do genuinely think that the future is in local models, the online stuff is 100% VC-powered cash market share grabs that will start failing when the forever loop of billions gets disrupted enough. But at the same time my attemps at comparing claude code + any local model have been such a clear win towards claude I can't bring myself to use a local model seriously just out of ideology.
- AntiUSAbah 6mo agoQuality, simplicity, speed. I have a ML Setup with 2 4090 and 128gb of ram, its warm when i use them for finetuning or batch processes. I do not run them for coding. Its a lot easier and nicer to play around with better models for just 20 $.
- operatingthetan 6mo agoWell they are subsidizing us for starters.
- victorbjorklund 6mo agoWhy give apple/nvidia your money?
- badsectoracula 6mo agoJokes on you, i'm running my local models on AMD :-P