4 ms·
I had one the other day where the AI search engine gave me a very odd result that got several important details blatantly wrong, and then started getting into w
by actsasbuffoon 1y ago
I had one the other day where the AI search engine gave me a very odd result that got several important details blatantly wrong, and then started getting into weird right-wing conspiracy territory. I checked the sources and it turns out that the first source it pulled in was from some kooky religious organization.
This isn’t a huge problem with search as it existed 5 years ago. You’ll see the URL and say, “That doesn’t sound like a reliable source. I’m going to scroll down a little further.”
But with AI search, the authorship is less obvious. It looks like the AI is saying it, rather than the AI just mashing together a bunch of search results with some garbage in the mix. It allows creeps, kooks, and nutballs to launder their ideas by getting AI to repeat their garbage.
It was a concerning interaction, and I worry how many impressionable people are being fed weird cult-spam while thinking that it’s legitimate because they don’t realize where it’s coming from.