4 ms·

> Why should videos that do not violate site policies be removed from recommended? The recommendation system seems out of control and I keep getting recommenda

> Why should videos that do not violate site policies be removed from recommended? The recommendation system seems out of control and I keep getting recommendations that I have not only never shown an interest in, but have actively expressed disinterest in when removing it. If they can't fix that, I'll welcome potentially biased human curators to clean it up from the vile crap that occasionally pops up there.

manfredo 8y ago
This is recommendations working as intended. If all people got was recommendations to what they already watch them they're no chance for new creators to get recommended. Also, I wrote a note quick program to use selenium to traverse YouTube recommendations. I didn't find any weird rabbit holes or anything. I can release the source code if you want, though I'm pretty sure similar tools already exist.
- Analemma_ 8y ago
  Speaking as someone who has scraped Google properties for a living in the past: your test was not reliable. Google is very good at detecting inhuman traffic, and they frequently silently degrade results rather than throw up a CAPTCHA, to give competitors bad information and not tip them off that their scraping is being detected (which would prompt the scrapers to better conceal themselves)
  - manfredo 8y ago
    I don't think so. It opened an incognito window over VPN. It then watched 50-100% of the video (randomly determined) before clicking a recommendation. I repeated the tests manually and got generally similar patterns of recommendations. I guess I could improve randomization of mouse movements, but I don't think they's much incentive for YouTube to detect automated browsers to control recommendations. Is your line of thinking that they say "hey, if we detect an automated browser we'll recommended a bunch of family friendly videos but when it's real users we'll recommended the creepy stuff?" That's pretty moustache-twirlingly conniving and I don't see a big incentive for YouTube to do this.
- boomlinde 8y ago
  > This is recommendations working as intended. If all people got was recommendations to what they already watch them they're no chance for new creators to get recommended. The problem wasn't that I got recommendations for videos that I hadn't watched, it's that I got recommendations for videos on topics that I had shown no interest at all in, and even worse, expressly denied interest in. Maybe after I've told the system that I'm not interested in watching a feminist getting rekt by Jordan Peterson for the tenth time the recommendation system can figure out that I don't care for the topic at all instead of just continuing to recommend Jordan Peterson videos from the seemingly thousands of other channels that post them.
  - deleted 8y ago
    [deleted]
  - repolfx 8y ago
    There's something incredibly weird about YouTube's algorithm, Jordan Peterson and Hacker News readers. That's a very common complaint. I've watched a few videos with him in and now my recommendations are also super-saturated with his vids. I actually think he's OK, albeit not anywhere near as strong a speaker as his followers like to think. And to be honest I did enjoy watching Cathy Newman getting rekt by him when that video first came out. So I guess I contributed in some microscopic way to your current pain. But even for me, YouTube acts like I watch the dude every single day - out of the 8 videos it's currently recommending to me, 2 of them involve him. This is way out of proportion. I suspect something about content involving him pushes lots of entirely legitimate buttons inside the recommendations engine. The organic growth in his popularity has been astronomical, and video comments are flooded with men saying watching his vids helped them turn their life around. So if I had to guess I'd say watching one Peterson video is highly, highly correlated with watching tons of them. I suspect people who only watch one vid for a few minutes and then forget about him are a much smaller group proportionally than most YouTubers. I also suspect that this behaviour highly correlates with the same demographics that read HN i.e. educated western men who probably don't watch lots of celebrity music videos. It also wouldn't surprise me if JP videos are way more virally shared than normal, as he inspires a somewhat evangelical fervour. That said, it's weird the recommendation engine can't pick up on being explicitly told "not interested". It makes me think the engine doesn't know the videos are JP related explicitly and it's picking up on other characteristics, so clicking "not interested" on these videos just looks kind of random and useless ("please don't show me this kind of popular video that strongly appeals to people like me" ... well ok mr youtuber but what else am i meant to do?)

manfredo 8y ago

This is recommendations working as intended. If all people got was recommendations to what they already watch them they're no chance for new creators to get recommended. Also, I wrote a note quick program to use selenium to traverse YouTube recommendations. I didn't find any weird rabbit holes or anything. I can release the source code if you want, though I'm pretty sure similar tools already exist.

Analemma_ 8y ago
Speaking as someone who has scraped Google properties for a living in the past: your test was not reliable. Google is very good at detecting inhuman traffic, and they frequently silently degrade results rather than throw up a CAPTCHA, to give competitors bad information and not tip them off that their scraping is being detected (which would prompt the scrapers to better conceal themselves)
- manfredo 8y ago
  I don't think so. It opened an incognito window over VPN. It then watched 50-100% of the video (randomly determined) before clicking a recommendation. I repeated the tests manually and got generally similar patterns of recommendations. I guess I could improve randomization of mouse movements, but I don't think they's much incentive for YouTube to detect automated browsers to control recommendations. Is your line of thinking that they say "hey, if we detect an automated browser we'll recommended a bunch of family friendly videos but when it's real users we'll recommended the creepy stuff?" That's pretty moustache-twirlingly conniving and I don't see a big incentive for YouTube to do this.
boomlinde 8y ago
> This is recommendations working as intended. If all people got was recommendations to what they already watch them they're no chance for new creators to get recommended. The problem wasn't that I got recommendations for videos that I hadn't watched, it's that I got recommendations for videos on topics that I had shown no interest at all in, and even worse, expressly denied interest in. Maybe after I've told the system that I'm not interested in watching a feminist getting rekt by Jordan Peterson for the tenth time the recommendation system can figure out that I don't care for the topic at all instead of just continuing to recommend Jordan Peterson videos from the seemingly thousands of other channels that post them.
- deleted 8y ago
  [deleted]
- repolfx 8y ago
  There's something incredibly weird about YouTube's algorithm, Jordan Peterson and Hacker News readers. That's a very common complaint. I've watched a few videos with him in and now my recommendations are also super-saturated with his vids. I actually think he's OK, albeit not anywhere near as strong a speaker as his followers like to think. And to be honest I did enjoy watching Cathy Newman getting rekt by him when that video first came out. So I guess I contributed in some microscopic way to your current pain. But even for me, YouTube acts like I watch the dude every single day - out of the 8 videos it's currently recommending to me, 2 of them involve him. This is way out of proportion. I suspect something about content involving him pushes lots of entirely legitimate buttons inside the recommendations engine. The organic growth in his popularity has been astronomical, and video comments are flooded with men saying watching his vids helped them turn their life around. So if I had to guess I'd say watching one Peterson video is highly, highly correlated with watching tons of them. I suspect people who only watch one vid for a few minutes and then forget about him are a much smaller group proportionally than most YouTubers. I also suspect that this behaviour highly correlates with the same demographics that read HN i.e. educated western men who probably don't watch lots of celebrity music videos. It also wouldn't surprise me if JP videos are way more virally shared than normal, as he inspires a somewhat evangelical fervour. That said, it's weird the recommendation engine can't pick up on being explicitly told "not interested". It makes me think the engine doesn't know the videos are JP related explicitly and it's picking up on other characteristics, so clicking "not interested" on these videos just looks kind of random and useless ("please don't show me this kind of popular video that strongly appeals to people like me" ... well ok mr youtuber but what else am i meant to do?)