3 ms·

Oh hey. Look what I found on page 2. Intel, Microsoft discuss plans to run Copilot locally on PCs instead of in the cloud Discussion: https://news.ycombinator

• tentacleuno 3y ago
  Oh yeah! I totally forgot about Intel's on-chip AI acceleration[1]. I'm not sure how well it works, but I know that it exists and nothing major is currently taking advantage of it AFAIK. Local Copilot sounds interesting, but I'd imagine it would be akin to the old Siri on iPhones where its use would be limited to controlling on-device settings. I've heard and read quite a lot about the dangers of that, though: with prompt injections being an issue with Copilot[0] (and Bing Chat frequently going crazy[2]), I can understand why Microsoft are very hesitant to give it any real control over the system. [0]: https://embracethered.com/blog/posts/2024/whoami-conditional-prompt-injection-instructions/ https://embracethered.com/blog/posts/2024/whoami-conditional... [0.1]: https://kai-greshake.de/posts/llm-malware/ https://kai-greshake.de/posts/llm-malware/ [1]: https://www.tomshardware.com/news/intel-details-meteor-lakes-ai-acceleration-for-pcs-vpu-unit https://www.tomshardware.com/news/intel-details-meteor-lakes... [1.1]: https://www.extremetech.com/computing/intel-announces-an-integrated-neural-ai-accelerator-in-meteor-lake https://www.extremetech.com/computing/intel-announces-an-int... (hard to find a good explanation of these accelerators) [2]: https://www.forbes.com/sites/siladityaray/2023/02/16/bing-chatbots-unhinged-responses-going-viral/ https://www.forbes.com/sites/siladityaray/2023/02/16/bing-ch...