3 ms·
Due to time constraints, it sounds like this would be a relatively simple integration that operates similar to standard ChatGPT - whereas, the rest of us are al
by Humphrey 2y ago
Due to time constraints, it sounds like this would be a relatively simple integration that operates similar to standard ChatGPT - whereas, the rest of us are all hoping for LLM powered Siri 2.0.
On device would be amazing, but I suspect GPT 4.0 would still be too large to be able to run on device - regardless on how much more Neural Engine grunt the next A series Apple chip has.
- Tagbert 2y agoI think that server-side AI is just one component in a module approach with them running as much as they can on-device and with their own models. Imagine an AI powered Siri that runs on device to handle a lot of the basic interaction and functions and then calls out to the server for more heavy lifting.