A big differentiator is that local models have access to more user data without sending anything over the wire (which ignoring privacy implications, isn’t free)

A big differentiator is that local models have access to more user data without sending anything over the wire (which ignoring privacy implications, isn’t free). Local models can also more easily plug into existing macOS/iOS facilities like AppleScript, Automator, Services, Shortcuts, and NSUserActivity which means they’ll be a lot more functional, with the ability to wire together apps that haven’t explicitly added AI support. In other words there’s a lot of potential here. If implemented well, LLM-powered Siri would have vastly more context and integration than anything else right out of the gate.