3 ms·

This is almost certainly what happened. Google's AI answers aren't magic -- they're just summarizing across searches. In this case, "Israel" + "Jordan" pulled b

This is almost certainly what happened. Google's AI answers aren't magic -- they're just summarizing across searches. In this case, "Israel" + "Jordan" pulled back a video with opposite views than the author. It's somewhat less obvious to debug, because it'll pull more context than Google wants to show in the UI. You can see this happening in AI mode, where it'll fire half a dozen searches and aggregate snippets of 100+ sites before writing its summary.

underdeserver 1y ago
Ironic, that Google enshittifying their search results is hurting what they hope is their next cash cow, AI.
- gumby271 1y ago
  I honestly don't know if people even care that the search result summaries are completely wrong the majority of the time. Most people I know see an answer given by Google and just believe it. To them that's the value, the accuracy doesn't really matter. I hope it ends up killing Google, but for the majority the shitty summary has replaced even shittier search results. On the surface it's a huge improvement, even if it's just distilled garbage.
  - larodi 1y ago
    there was a joke like 15 years ago in googlis non est, ergo non est which sums very well how people are super biased to believe the search results.
ludicrousdispla 1y ago
Interesting, I wonder what Google AI has to say about Stove Top Stuffing given it's association with Turkey.
sigmoid10 1y ago
There is actually a musician called Benn Jordan who was impersonated by someone on twitter who posted pro-Israel content [1]. That content is no longer available, but it might have snuck into the training data, i.e. Benn Jordan = pro Israel. This might also have been set in relation to the other Jordan's previous pro-Palestine comments, eventually misattributing the "I was wrong about Israel" video. It's still a clear fuckup - but I could see humans doing something similar when sloppily accruing information. [1] https://www.webpronews.com/musician-benn-jordan-exposes-fake-x-account-impersonating-his-views/ https://www.webpronews.com/musician-benn-jordan-exposes-fake...
- ants_everywhere 1y ago
  That article is about the same Benn Jordan in the Bluesky post. The photo in the article is not of Benn Jordan. Benn Jordan has several videos and projects devoted to "digital sabotage", e.g. https://www.google.com/search?hl=en&q=benn%20jordan%20data%20poisoning https://www.google.com/search?hl=en&q=benn%20jordan%20data%2... So this all kind of looks on its face like it's just him trolling. There may be ore than just what's on the face of course. For example, it could be someone else trolling him with his own methods.
  - sigmoid10 1y ago
    That makes it even more believable that an LLM screwed up. I mean what are you supposed to believe at this point?
    - ants_everywhere 1y ago
      I guess so. But the situation we're in is that someone who does misinformation is claiming an LLM believed misinformation. Step one would be getting an someone independent, ideally with some journalistic integrity, to verify Benn's claims. Generally speaking if your aunt sally claims she ate strawberry cake for her birthday, the LLM or Google search has no way of verifying that. If Aunt Sally uploads a faked picture of her eating strawberry cake, the LLM is not going to go to her house and try to find out the truth. So if Aunt Sally is lying about eating strawberry cake, it's not clear what search is supposed to return when you ask whether she ate strawberry cake.

underdeserver 1y ago

Ironic, that Google enshittifying their search results is hurting what they hope is their next cash cow, AI.

gumby271 1y ago
I honestly don't know if people even care that the search result summaries are completely wrong the majority of the time. Most people I know see an answer given by Google and just believe it. To them that's the value, the accuracy doesn't really matter. I hope it ends up killing Google, but for the majority the shitty summary has replaced even shittier search results. On the surface it's a huge improvement, even if it's just distilled garbage.
- larodi 1y ago
  there was a joke like 15 years ago in googlis non est, ergo non est which sums very well how people are super biased to believe the search results.

ludicrousdispla 1y ago

Interesting, I wonder what Google AI has to say about Stove Top Stuffing given it's association with Turkey.

sigmoid10 1y ago

There is actually a musician called Benn Jordan who was impersonated by someone on twitter who posted pro-Israel content [1]. That content is no longer available, but it might have snuck into the training data, i.e. Benn Jordan = pro Israel. This might also have been set in relation to the other Jordan's previous pro-Palestine comments, eventually misattributing the "I was wrong about Israel" video. It's still a clear fuckup - but I could see humans doing something similar when sloppily accruing information. [1] https://www.webpronews.com/musician-benn-jordan-exposes-fake-x-account-impersonating-his-views/ https://www.webpronews.com/musician-benn-jordan-exposes-fake...

ants_everywhere 1y ago
That article is about the same Benn Jordan in the Bluesky post. The photo in the article is not of Benn Jordan. Benn Jordan has several videos and projects devoted to "digital sabotage", e.g. https://www.google.com/search?hl=en&q=benn%20jordan%20data%20poisoning https://www.google.com/search?hl=en&q=benn%20jordan%20data%2... So this all kind of looks on its face like it's just him trolling. There may be ore than just what's on the face of course. For example, it could be someone else trolling him with his own methods.
- sigmoid10 1y ago
  That makes it even more believable that an LLM screwed up. I mean what are you supposed to believe at this point?
  - ants_everywhere 1y ago
    I guess so. But the situation we're in is that someone who does misinformation is claiming an LLM believed misinformation. Step one would be getting an someone independent, ideally with some journalistic integrity, to verify Benn's claims. Generally speaking if your aunt sally claims she ate strawberry cake for her birthday, the LLM or Google search has no way of verifying that. If Aunt Sally uploads a faked picture of her eating strawberry cake, the LLM is not going to go to her house and try to find out the truth. So if Aunt Sally is lying about eating strawberry cake, it's not clear what search is supposed to return when you ask whether she ate strawberry cake.