6 ms·
The YouTube recommendation system is optimized to direct all users toward pools of content that have the highest amount of watch time. The AI has learned about
by neonnoodle 4y ago
The YouTube recommendation system is optimized to direct all users toward pools of content that have the highest amount of watch time. The AI has learned about various paths that get users to watch for longer amounts of time. One of those paths is right-wing polemics. Another path is, say, makeup tutorials. It's not inherently political.
Purely by its own machine learning, the YouTube algorithm becomes sophisticated at inching people toward the high-watchtime material. There is no mal intent. There's no intent at all except for revenue. The AI doesn't "know" what the content of the reactionary videos even is. All it "knows" is that people who get there watch longer, and that people get there by way of other interests, such as martial arts, history, or guns. It also "knows" that this transition has to happen gradually to succeed. The recommendation progression is subtle:
Martial arts -> combat -> guns/militaria -> liberals are coming to seize your guns
Martial arts -> combat -> guns/militaria -> look at this neat Nazi gun -> were the Nazis so wrong???
Martial arts -> MMA -> Joe Rogan -> Jordan Peterson -> feminism is destroying Western civilization
Martial arts -> MMA -> Joe Rogan -> (((George Soros))) is a space reptile
Your line of questioning assumes that this process is malfunctioning, when in fact it is working as intended. You're correct that it's ethically grotesque, but since when have companies ever taken responsibility for externalities without being compelled to via regulation? YouTube has the legal right to host and broadcast whatever (non-obscene, non-copyrighted) content makes it the most money. The only free-market answer would be advertisers pulling money, which they occasionally do as a disciplinary mechanism. But if the advertisers don't really care, well...
- jshaqaw 4y agoI absolutely get the recommendsation progression. I'm a pragmatist and a capitalist. I'm not demanding a ban on anything. But when a user explicitly says "NO NO STOP YOU HAVE IT WRONG" and it has no impact then it is not optimal design, it is bad design, and not possibly revenue maximizing. Fixing it would also be a great way for these companies to stop stepping in public relations unforced errors.
- bardan 4y agoI wonder if their attitude is "hey, you clicked on it once buddy. chances are you're a little curious, and people really engage with this material"
- neonnoodle 4y agoPretty much. It costs them nothing to keep pecking. The odds of a user actually leaving YouTube for good are pretty minimal.
- tomcam 4y ago> One of those paths is right-wing polemics. Agreed completely. Uh… is it your thought that they do not employ left-wing polemics for precisely the same reason? Because https://news.ycombinator.com/item?id=34463025 https://news.ycombinator.com/item?id=34463025