4 ms·
Yes and no. Context matters. Will models of similar quality to the current LLaMA, GPT, and Stable Diffusion be running locally on devices and edge systems? Ver
by godelski 3y ago
Yes and no. Context matters.
Will models of similar quality to the current LLaMA, GPT, and Stable Diffusion be running locally on devices and edge systems? Very likely.
Will much higher quality models that still require compute incapable by such edge or consumer devices be available, sold as a service, and in high use? Also very likely.
So expect current quality to make it to your devices but don't expect to necessarily move everything to local because the whole ecosystem will improve too. Overton window will shift and it's like asking if gaming will move to phones. In some ways yes, in other ways you're still going to want to buy that Playstation/Xbox/PC.