6 ms·
Ask HN: Are we gonna back less powerful local LLMs
As developers, We are using very powerful llms.But pricing are getting higher day by day.Many developers start to get mac mini for local llms.At the end of the day, are we gonna back to not very powerfull llms because of costs? What Do you think?
- aurareturn 5mo agoFunny I just came across a comment that accurately answers your question: https://news.ycombinator.com/item?id=48047722 https://news.ycombinator.com/item?id=48047722
- omertt27 5mo agoThanks!
- al_borland 5mo agoThis is one take. Not every project is made better by expanding the scope by 100x. This often makes things worse.
- aurareturn 5mo agoOne of the hardest things to do in software is to make things simple and easy to use. That could mean increasing the scope to do so. Scope doesn't automatically mean more bloat.
- marcus_ai 5mo ago[flagged]
- kadam2576 5mo ago[dead]
- sdevonoes 5mo agoThe same way most of us use linux (not windows) and postgres/mysql (not oracle), many of us are using open source models and not proprietary ones.
- omertt27 5mo agoyeah, i understand
- Jinyibruceli 5mo ago[flagged]
- frangonf 5mo agoI think the trend is that top models are meant for companies. Small devs did our job of hyping and training and we can now either pay way more, or pay more and use not sota models, or give our data to access train chinese models in hopes they keep 6 months behind in the cold war and need still need some of our input, or invest around 5-10K for powerful local personal AI [0]. On the other hand I think that AI can really raise the bar of "average tech", and we devs are wired to think that better tech == more value... but this might not be the case in the many many many cases where existing average tech and velocity is already good enough and the real moat is the handshake, trust, marketing, etc etc [0] https://github.com/antirez/ds4 https://github.com/antirez/ds4
- lalsanhim 5mo agoI need a proficinal hiking system
- coalstartprob 5mo ago[dead]
- skillsora 5mo ago[flagged]
- adrianwaj 5mo agoI'd expect to see more AI pools (like mining pools) develop over time. So it's the "team local" model. See Gensyn Protocol.
- omertt27 5mo agoThanks for the advice
- chistev 5mo agoI saw a tweet that eventually companies will realize it's more expensive using AI that they then return to human developers. Lol. The irony that would be.