11 ms·
Apple Intelligence has an LLM that runs locally on the iPhone (15 Pro and up). But the quality of Apple Intelligence shows us what happens when you use a tiny
by winter_blue 2y ago
Apple Intelligence has an LLM that runs locally on the iPhone (15 Pro and up).
But the quality of Apple Intelligence shows us what happens when you use a tiny ultra-low-wattage LLM. There’s a whole subreddit dedicated to its notable fails: https://www.reddit.com/r/AppleIntelligenceFail/top/?t=all https://www.reddit.com/r/AppleIntelligenceFail/top/?t=all
One example of this is “Sorry I was very drunk and went home and
crashed straight into bed” being summarized by Apple Intelligence as ”Drunk and crashed”.
- deleted 2y ago[deleted]
- Spooky23 2y agoI think the real problem with LLMs is we have deterministic expectations of non-deterministic tools. We’ve been trained to expect that the computer is correct. Personally, I think the summaries of alerts is incredibly useful. But my expectation of accuracy for a 20 word summary of multiple 20-30 word summaries is tempered by the reality that’s there’s gonna be issues given the lack of context. The point of the summary is to help me determine if I should read the alerts. LLMs break down when we try to make them independent agents instead of advanced power tools. Alot of people enjoy navel gazing and hand waving about ethics, “safety” and bias… then proceed to do things with obvious issues in those areas.
- mewpmewp2 2y agoLarger LLMs can summarize all of this quite well though.
- hansvm 2y agoDeterminism isn't the issue though. Many responses are fine. The displayed one is bad, whether chosen deterministically or not. Some alternatives: - Passed out drunk - Crashed in bed - Slacking because drunk ... The issue isn't a lack of context; it's that even the available context was handled poorly.