I posed this exact same test problem to a selected LLM. It produced the correct answer --- including pointing out the irrelevance of the "smaller" kiwis. Then

I posed this exact same test problem to a selected LLM. It produced the correct answer --- including pointing out the irrelevance of the "smaller" kiwis. Then I changed the person's name (John instead of Oliver) and jiggled the numbers a bit. It confidently produced an answer including an explanation with the irrelevance noted --- but it still did the simple addition wrong. It obviously doesn't *understand* anything. It just regurgitates what it finds posted somewhere on the internet. Frankly, I wouldn't trust anything it says. It's hard to imagine what this would be truly useful for --- propaganda maybe? Billions and billions of dollars are being wasted on this.