2 ms·
If the future is AI, then a future where every compute has to pass through one of a handful of multinational corporations with GPU farms...is something to be wa
by hapticmonkey 1y ago
If the future is AI, then a future where every compute has to pass through one of a handful of multinational corporations with GPU farms...is something to be wary of. Local LLMs is a great idea for smaller tasks.
- tonyhart7 1y agobut its not the future, we already can do that right now the problem is people expectation, they want the model to be smart people aren't having problem for if its local or not, but they want the model to be useful
- aurareturn 1y agoSure, that's why local LLMs aren't popular or mass market as of September 2025. But cloud models will have diminishing returns, local hardware will get drastically faster, and techniques to efficiently inference them will be worked out further. At some point, local LLMs will have its day.
- tonyhart7 1y agoonly in theory and that's not gonna be happening this is the same happening with software and game industry because free market forces people to raise the bar every year, the requirement of apps and games never met. its only goes up human would never be satisfied, boundary would be push further that's why we have 12gb or 16gb ram for smartphone right now only for system + apps and now we must accommodate for local LLM too??? it would only goes up, people would demand smarter and smarter model frontier model today would deem unusable(dumb) in 5 years example: people literally screaming in agony when Antrophic quantized their model