4 ms·
I think it's weird that folks in this thread don't like the idea of having local AI features on laptops. This seems like a great opportunity to control one's o
by wyldfire 2y ago
I think it's weird that folks in this thread don't like the idea of having local AI features on laptops.
This seems like a great opportunity to control one's own data and continue leveraging open source AI models.
I've used Linux laptops for the past ~20 years almost and this seems like something that'll compete well with MacBooks.
Only drawback is that all the ARM-based ecosystems seem less open but I can see Qualcomm is engaging with folks like Canonical and I'm optimistic I can get a Linux version of one of these.
- lolinder 2y agoI have ollama set up on a beefy desktop and it's a neat toy, but it's definitely not yet to the point of being useful enough that I'd want it bundled with the OS, and that's with the latest and greatest open source models running on a gaming rig. The kind of models Microsoft can reliably run locally on a typical PC are going to be pretty poor.
- wyldfire 2y agoFrom what I understand, the NSP on these SoCs performs better on inferences than any other mobile GPU/neural engine. But yeah probably some very significant limitations when it comes to LLMs for this generation anyway. Forget about whatever models Microsoft ships, put whatever ones you want on there.
- PKop 2y agoTo do what with them? How about not putting any of them on there? Doesn't chatting with bots get boring very quickly?
- PKop 2y agoI think it's weird that folx find anything useful about these gimmicky toy "AI's" that make up nonsense and get in the way of using your computer; why would you want these things injected into every nook and cranny of your operating system?