6 ms·

Great! But nothing is going to change until people realize that the problem is the feedback loop. It's not the recommendation engine itself, it's the fact that

Great! But nothing is going to change until people realize that the problem is the feedback loop. It's not the recommendation engine itself, it's the fact that there's no way "out" of the feed that the engine produces. It recommends you stuff, you have little choice but to engage with it, and then it trains on that information. This is the problem with most of social media today. It is a very well known problem in ML [1], but nobody is willing to do anything about it because it's a fundamental UX change. Facebook, Twitter, YouTube, TikTok, they have defined themselves by their recommendation engines. [1] https://towardsdatascience.com/dangerous-feedback-loops-in-ml-e9394f2e8f43 https://towardsdatascience.com/dangerous-feedback-loops-in-m...

rejectfinite 4y ago
I feel like the Youtube one is good. You can mark videos and channels as "not interested" and Youtbe really knows me due to my account age and usage... It recommends me unknown videos and I tend to like them but also more mainstream stuff.
- phailhaus 4y ago
  It doesn't matter how good they try to make their recommendation system, they will never know you like yourself. For example, when I go to the YouTube home page, there is a list of categories at the top that it's identified for me. I didn't choose these. I can't add or remove them myself if it's wrong. I just have to hope that I watch the "right videos" and it picks up on a new interest that I have. But I already know what interests I have! I want to have videos about terrariums on my home page now, not in a week when I've watched enough. This is what I mean by recommendation systems not being good enough. They need to give the user more control over what they want to see, because they can never read my mind. Their recommendations will get even better with that information!
khy 4y ago
I think Instagram in particularly is bad in this regard. It seemingly becomes convinced that I care deeply about the subject of any post that I even momentarily linger on.
dmonitor 4y ago
reminds me of a story about a guy who was given a gift, a decorative plate with a rooster on it i think it was. didn’t care for it too much, but out of politeness put it on display on an empty cabinet he had. a while later someone noticed he had it and figured he liked it, so got him a similar decorative plate with a rooster on it. again, out of politeness, he put it next to the old one. now other people started to think he just really liked roosters, and started giving him little rooster statues and nicknacks. Eventually he just has a whole display cabinet of rooster themed gifts that he never really cared for to begin with, but people just assume he likes them because people keep giving them to him.
- Washuu 4y ago
  I have a whole shelf full of horse stuff because of this!~
- bluegate010 4y ago
  https://www.smbc-comics.com/comic/critical https://www.smbc-comics.com/comic/critical
- cscompman 4y ago
  [flagged]
- yeetard 4y ago
  this is a hilarious example for a serious problem. well done!
- bluesign 4y ago
  and in the end, he starts to like that decorative plates with roosters or at least thinks rooster on plate is a nice decoration if it is produced that much.
- whiddershins 4y ago
  I had a friend who this happened to with ducks. You would go to her house and there were little duck icons and duck figurines and duck themed things everywhere. When questioned, it turns out she never cared about or liked ducks. Someone gave her one and then it became the go to present for her for every occasion, for decades. Decades of ducks.
LZ_Khan 4y ago
Don't you have a choice.. to not engage with it? If you didn't like it then assuming the metrics system is working correctly, this would be negative feedback to the ML model, causing said content to not be shown in the future.
- phailhaus 4y ago
  Couple problems: 1. Actively supplying negative feedback is sometimes hidden behind secondary menus, making it much higher friction compared to just...scrolling past. So most users don't spend the effort. Even with a dislike button, it's unclear what the system is learning. It can't know that I don't like this particular video because it's a conspiracy theory, and to stop showing me those. These platforms often don't even support explicit categories, so how would they know? 2. It's extremely high friction to teach the algorithm you're interested in something that it doesn't suggest to you! There's the whole unknown unknowns problem: how do you teach the algorithm you're interested in something that you've never seen before? I still think Reddit has handled this the best. No system is perfect, but Reddit's challenges are much more manageable than the quagmire that TikTok, Facebook, and YouTube have gotten themselves into. I can just unsubscribe from r/conspiracy, and I'm out. Basically impossible to teach that to YouTube without weeks of careful curation. They think they're smart enough to know what I like, but they're not and never will be.
  - zrezzed 4y ago
    Twitter could recreate a similar system: 1) auto-tag tweets with labels, rather than users needing to submit to subreddits 2) auto-sub most people some default set of labels 3) let them un-sub if they want. They just don't want to.
    - phailhaus 4y ago
      Auto-tagging is not a business they want to be in, because they will invariably get it wrong sometimes and people will start drama over it. And they'd be right to: human communication is nuanced and you can't just "guess" what someone means within 280 characters. People already use hashtags, what would happen if you could subscribe to them? It would create a whole new way of interacting with the platform, something closer to Reddit where people post to streams. But the fact that these streams can't be moderated (or even downvoted) might be a nonstarter.
hdivider 4y ago
Thank you! Working on a concept for a big org on what may become a large ML-based system one day. I knew about this feedback loop issue, but was too dumb to actually remember and face this problem. :) It's all over today's rec engines -- and yet, just like the things we're not shown in these systems, the problem itself seems to become invisible. Because it requires new thinking. Worth exploring.
- phailhaus 4y ago
  Reddit is a good example of an alternative system, and it works because subreddits serve as lower-variance composable streams as well as shared digital spaces. Even though your main feed is partially driven by a recommendation engine, it never contains any content that you didn't subscribe to (ignoring ads, of course). Instead, you may see a "posts from other subreddits" section that breaks up the feed explicitly to offer alternatives. If you're interested in a particular topic, you can drop into that subreddit, where you'll see pretty much the same view as everyone else. In all these cases, you're always in control. I wouldn't be surprised if Reddit actually has the best data on their user's preferences, because they let them explicitly decide what they want rather than playing this "hot and cold" game like TikTok. Those platforms also only let you subscribe to individual accounts, so they have to infer what your interests actually are.
seydor 4y ago
So , all we need to do is to open source humans?
- phailhaus 4y ago
  Haha no, we just need to stop pretending as if ML can read our minds. It's a tool, it's good at recommending me content, but it will never know what I'm in the mood for on a particular Friday night.
mgiannopoulos 4y ago
Isn’t the “I’m not interested in this tweet”, “Show me fewer tweets from X”, etc options working for you? They seem to have an effect on my end.
- phailhaus 4y ago
  What did they learn though? They can't possibly know why I'm not interested in that tweet, because there's just not enough information. So all they'll do is stop showing me tweets from that one person. No way to express "yeah I'm interested in his tweets about music, not gardening." The problem is that mostly following people means that you can't teach the algorithm about your particular interests. Topics are better, but there doesn't seem to be a way to make sure your tweet ends up in a particular topic. Again, you have to pray to The Algorithm that it will label tweets correctly. And if your particular interest isn't a Topic, you're out of luck.

rejectfinite 4y ago

I feel like the Youtube one is good. You can mark videos and channels as "not interested" and Youtbe really knows me due to my account age and usage... It recommends me unknown videos and I tend to like them but also more mainstream stuff.

phailhaus 4y ago
It doesn't matter how good they try to make their recommendation system, they will never know you like yourself. For example, when I go to the YouTube home page, there is a list of categories at the top that it's identified for me. I didn't choose these. I can't add or remove them myself if it's wrong. I just have to hope that I watch the "right videos" and it picks up on a new interest that I have. But I already know what interests I have! I want to have videos about terrariums on my home page now, not in a week when I've watched enough. This is what I mean by recommendation systems not being good enough. They need to give the user more control over what they want to see, because they can never read my mind. Their recommendations will get even better with that information!

khy 4y ago

I think Instagram in particularly is bad in this regard. It seemingly becomes convinced that I care deeply about the subject of any post that I even momentarily linger on.

dmonitor 4y ago

reminds me of a story about a guy who was given a gift, a decorative plate with a rooster on it i think it was. didn’t care for it too much, but out of politeness put it on display on an empty cabinet he had. a while later someone noticed he had it and figured he liked it, so got him a similar decorative plate with a rooster on it. again, out of politeness, he put it next to the old one. now other people started to think he just really liked roosters, and started giving him little rooster statues and nicknacks. Eventually he just has a whole display cabinet of rooster themed gifts that he never really cared for to begin with, but people just assume he likes them because people keep giving them to him.

Washuu 4y ago
I have a whole shelf full of horse stuff because of this!~
bluegate010 4y ago
https://www.smbc-comics.com/comic/critical https://www.smbc-comics.com/comic/critical
cscompman 4y ago
[flagged]
yeetard 4y ago
this is a hilarious example for a serious problem. well done!
bluesign 4y ago
and in the end, he starts to like that decorative plates with roosters or at least thinks rooster on plate is a nice decoration if it is produced that much.
whiddershins 4y ago
I had a friend who this happened to with ducks. You would go to her house and there were little duck icons and duck figurines and duck themed things everywhere. When questioned, it turns out she never cared about or liked ducks. Someone gave her one and then it became the go to present for her for every occasion, for decades. Decades of ducks.

LZ_Khan 4y ago

Don't you have a choice.. to not engage with it? If you didn't like it then assuming the metrics system is working correctly, this would be negative feedback to the ML model, causing said content to not be shown in the future.

phailhaus 4y ago
Couple problems: 1. Actively supplying negative feedback is sometimes hidden behind secondary menus, making it much higher friction compared to just...scrolling past. So most users don't spend the effort. Even with a dislike button, it's unclear what the system is learning. It can't know that I don't like this particular video because it's a conspiracy theory, and to stop showing me those. These platforms often don't even support explicit categories, so how would they know? 2. It's extremely high friction to teach the algorithm you're interested in something that it doesn't suggest to you! There's the whole unknown unknowns problem: how do you teach the algorithm you're interested in something that you've never seen before? I still think Reddit has handled this the best. No system is perfect, but Reddit's challenges are much more manageable than the quagmire that TikTok, Facebook, and YouTube have gotten themselves into. I can just unsubscribe from r/conspiracy, and I'm out. Basically impossible to teach that to YouTube without weeks of careful curation. They think they're smart enough to know what I like, but they're not and never will be.
- zrezzed 4y ago
  Twitter could recreate a similar system: 1) auto-tag tweets with labels, rather than users needing to submit to subreddits 2) auto-sub most people some default set of labels 3) let them un-sub if they want. They just don't want to.
  - phailhaus 4y ago
    Auto-tagging is not a business they want to be in, because they will invariably get it wrong sometimes and people will start drama over it. And they'd be right to: human communication is nuanced and you can't just "guess" what someone means within 280 characters. People already use hashtags, what would happen if you could subscribe to them? It would create a whole new way of interacting with the platform, something closer to Reddit where people post to streams. But the fact that these streams can't be moderated (or even downvoted) might be a nonstarter.

hdivider 4y ago

Thank you! Working on a concept for a big org on what may become a large ML-based system one day. I knew about this feedback loop issue, but was too dumb to actually remember and face this problem. :) It's all over today's rec engines -- and yet, just like the things we're not shown in these systems, the problem itself seems to become invisible. Because it requires new thinking. Worth exploring.

phailhaus 4y ago
Reddit is a good example of an alternative system, and it works because subreddits serve as lower-variance composable streams as well as shared digital spaces. Even though your main feed is partially driven by a recommendation engine, it never contains any content that you didn't subscribe to (ignoring ads, of course). Instead, you may see a "posts from other subreddits" section that breaks up the feed explicitly to offer alternatives. If you're interested in a particular topic, you can drop into that subreddit, where you'll see pretty much the same view as everyone else. In all these cases, you're always in control. I wouldn't be surprised if Reddit actually has the best data on their user's preferences, because they let them explicitly decide what they want rather than playing this "hot and cold" game like TikTok. Those platforms also only let you subscribe to individual accounts, so they have to infer what your interests actually are.

seydor 4y ago

So , all we need to do is to open source humans?

phailhaus 4y ago
Haha no, we just need to stop pretending as if ML can read our minds. It's a tool, it's good at recommending me content, but it will never know what I'm in the mood for on a particular Friday night.

mgiannopoulos 4y ago

Isn’t the “I’m not interested in this tweet”, “Show me fewer tweets from X”, etc options working for you? They seem to have an effect on my end.

phailhaus 4y ago
What did they learn though? They can't possibly know why I'm not interested in that tweet, because there's just not enough information. So all they'll do is stop showing me tweets from that one person. No way to express "yeah I'm interested in his tweets about music, not gardening." The problem is that mostly following people means that you can't teach the algorithm about your particular interests. Topics are better, but there doesn't seem to be a way to make sure your tweet ends up in a particular topic. Again, you have to pray to The Algorithm that it will label tweets correctly. And if your particular interest isn't a Topic, you're out of luck.