3 ms·
Yea, that's the way they're going based on the low-memory models they're building. Basically all the LLM needs to do is translate human writing to some format
by theshrike79 3y ago
Yea, that's the way they're going based on the low-memory models they're building.
Basically all the LLM needs to do is translate human writing to some format that a "normal" service can use. That can then leverage the existing spotlight system that's pretty decent at searching stuff on the phone anyway.
Then it'll report it back to the LLM which translates whatever format back to something humans can process.
Basically "less shit Siri"