Google Search's AI Overview just the other day confidently mis-summarized a source so badly that it came to the exact opposite conclusion to what the source act

Google Search's AI Overview just the other day confidently mis-summarized a source so badly that it came to the exact opposite conclusion to what the source actually contained: https://imgur.com/a/WL8KzdB https://imgur.com/a/WL8KzdB Yes, AI Overview is a pretty weak model, but it somehow got "yes, that photo is AI" from an article explaining "not only is that photo not AI, here is the reporter who took the photo." The other thing is that it is often hard to tell whether a model is talking about a source because the surrounding system has run a search and injected it into the prompt, or whether it's just freestyling based on its training data.