3 ms·
> Apple is already deploying smaller LLMs to macOS hm?
by comboy 3y ago
> Apple is already deploying smaller LLMs to macOS
hm?
- oceanplexian 3y agoI don't know about macOS but they are supposedly including a local, transformer-based language model for autocorrect in iOS 17
- Spartan-S63 3y agoTheir improvements to the keyboard auto-correction features is coming to their new software as an on-device LLM. Basically, it looks like they're improving the neural engines on their chips, over time, to start running more LLMs on-device to ensure user data privacy.
- tcmart14 3y agoI've only dabbled in development in xcode a little. Most of my programming on my M1 are C and Rust programs. But the tooling for apple apps (macOS, iOS, etc) in xcode make it pretty easy with Core ML to make some models and bundle it into your app to run locally on the device it gets installed on. At least that is my understanding on playing with it (someone with more experience with CoreML correct me if I am wrong on that). So its not just Apple themselves, but they make it easier for developers to do it also.