3 ms·
One of the most interesting things about Apple's design here is that by heavily restricting the ways in which their on-device LLMs are used they've massively re
by simonw 2y ago
One of the most interesting things about Apple's design here is that by heavily restricting the ways in which their on-device LLMs are used they've massively reduced the scope for hallucination.
It's far less likely to cause problems when limited to tasks like summaries, copy editing and short text rewording.
Hallucination is most likely to cause headline-grabbing mistakes when you use LLMs to answer questions about the world or generate larger volumes of text from a short prompt. Apple effectively outsource that to a clearly branded ChatGPT integration, neatly assigning any blame for hallucinations to OpenAI.