4 ms·
>API for AI results than it will be to run it locally. True, and remotely called APIs will always be the mover for the AI craze. Only niche hobbyists will be ru
by atleastoptimal 4y ago
>API for AI results than it will be to run it locally.
True, and remotely called APIs will always be the mover for the AI craze. Only niche hobbyists will be running them locally.
There is no company on the planet that would benefit from providing people local means to run LLMs. As a result only hacks and leaks will be how individuals can manage to run LLMs outside of heavily monitored remote API calls.
- mikek 4y agoApple comes to mind.
- BryantD 4y agoAgreed. Apple will run models remotely if necessary, but from a PR perspective they align with their stated intentions when they can run locally.
- mustacheemperor 4y agoOh, how I hope there is a project ongoing at Apple right now to implement some kind of on-device LLM that can drive the phone a la Siri. Any time I open the Bing app on my iPhone to answer a question I think of how useful it could be to ask it to update my calendar, fill out a dinner order, etc. How much time do we collectively waste putzing around with delivery apps etc?
- smoldesu 4y agoIt would be neat, but iPhone hardware has limited memory (and iOS limits that usage further). It would be much faster and higher-quality to run it as an API request like it is today.
- yieldcrv 4y agoGiven the incentive, it can push the hardware in this direction. Or they’ll do a home network device like implement it like a HomeKit hub. So the plugged in resource has more computational power and feeds it to iphones when nearby. Disconnected, the iphone uses a much more rudimentary one or falls back to Siri or a cloud service.
- gpderetta 4y agoApple Siri as a device you can run on your home as a digital assistant.
- flangola7 4y agoWho said anything about companies? Companies don't benefit by giving people free access to buildings full of books and knowledge, yet here they are.
- atleastoptimal 4y agoIn the last 50 years of AI research has any academic institution ever provided open source easy to use tools like the stuff big companies have put out in the past 5 years?
- simonw 4y agoStable Diffusion came from an academic research lab.
- atleastoptimal 4y agoI thought stability AI was a private company
- simonw 4y agoThey are, but the team who trained Stable Diffusion are from academia. Stability sponsored the model training costs.
- flangola7 4y agoAs I'm aware neither had put out any such tools for 45 years
- niemandhier 4y agoCompanies like Facebook can harm their competitors by releasing models. Facebook is not a major player in the Llm field, the technological advantage of openai is to large, BUT they can reduce the expected gains of their competition by providing less powerful alternatives for free.
- ALittleLight 4y agoFacebook may destroy their social networks by releasing LLMs. What will happen to spam when it could be driven by local LLMs? You'll have realistic accounts, with realistic pictures, posting realistic messages only to spam links or ads x% of the time. (Though to be clear I do hope Facebook does release more models because I want to play with them)
- smoldesu 4y agoI wouldn't count on it. However, I definitely think Facebook's remaining managers are scrambling to control this LLaMa leak though. They don't want the liability or responsibility of managing this project, and now everyone and their mother wants to play with it. Battling spam can largely be managed through the usual methods, but fighting a leaked model is much harder.