3 ms·
I have ollama set up on a beefy desktop and it's a neat toy, but it's definitely not yet to the point of being useful enough that I'd want it bundled with the O
by lolinder 2y ago
I have ollama set up on a beefy desktop and it's a neat toy, but it's definitely not yet to the point of being useful enough that I'd want it bundled with the OS, and that's with the latest and greatest open source models running on a gaming rig. The kind of models Microsoft can reliably run locally on a typical PC are going to be pretty poor.
- wyldfire 2y agoFrom what I understand, the NSP on these SoCs performs better on inferences than any other mobile GPU/neural engine. But yeah probably some very significant limitations when it comes to LLMs for this generation anyway. Forget about whatever models Microsoft ships, put whatever ones you want on there.
- PKop 2y agoTo do what with them? How about not putting any of them on there? Doesn't chatting with bots get boring very quickly?