8 ms·
I'm not sure if it is because of weird tastes or something else. But for sites like Steam, YT, Netflix I always wish for more tuning parameters because their re
by Semaphor 9y ago
I'm not sure if it is because of weird tastes or something else. But for sites like Steam, YT, Netflix I always wish for more tuning parameters because their recommendations are all horrible.
On Netflix, for example, I get recommended stuff that's similar to other things I didn't like.
Amazon is often the best of them for books because their engine seems to only really value the last few things I looked at / bought and so just recommends really similar stuff. Of course, that fails hard whenever I look at something I'm not interested in for whatever reason.
On Steam I wish they had some elaborate filtering system, there are so many games, I need something like NOT(Adventure+Puzzle) BOOST(RPG), I need to combine tags, not just filter them out by themselves.
- crowbahr 9y agoNetflix, I think, has killed their own recommendation algorithm when they removed stars and made it boolean. I don't know if those buttons even do anything anymore because I think they're just matching based off demographic and who they're trying to market to now. It's recommending shows that I never would watch in a million years and giving them high matches despite me disliking most similar shows just because I'm a 20-something male.
- ryanmaclean 9y agoI can't agree more - I'm a huge proponent for star rating systems. I get that they are perhaps more complicated than a Boolean value, but they help me out personally. I miss the days of "tap tap scroll four clicks" on the iPod to help me rate new music, specifically.
- swenn 9y agoInteresting experience, I recently read an article that gave me the impression that they rather improved the system. Excerpt from https://www.appcues.com/blog/rating-system-ux-star-thumbs/ https://www.appcues.com/blog/rating-system-ux-star-thumbs/ "In addition to the new rating system, Netflix has new match percentages (up to 100%) to more accurately predict how much users will like something. ... The new rating system received 200% more ratings in A/B tests, according to Netflix VP of Product Todd Yellin. When it comes to rating movies and shows, stars reflect the preferences that people want to have, rather than how people actually behave. Todd gave the example of users giving 5 stars to a documentary but just 3 stars to an Adam Sandler movie that they watched over and over again. “What you do versus what you say you like are different things,” said Todd."
- scythe 9y ago>When it comes to rating movies and shows, stars reflect the preferences that people want to have, rather than how people actually behave. Todd gave the example of users giving 5 stars to a documentary but just 3 stars to an Adam Sandler movie that they watched over and over again. “What you do versus what you say you like are different things,” said Todd." There's a reasonable objection to this behavioral definition of "like", which is that it doesn't actually make people's lives better, it just fills them with more compulsive behavior. It's not necessarily "irrational" to wish you were more patient, or to want to ask Netflix to show you useful things rather than useless fluff. That you occasionally betray your stated goals does not mean you should be denied the right of self-definition. In other words, what people say they like is more important, to me at least. See eg "Thinking Fast and Slow" by Kahneman.
- dkarl 9y agoIf Netflix was trying to ensure that what I was mostly likely to watch next had the highest star rating, no wonder they gave up on it. Our opinion of the quality of something is not a good predictor of our likelihood of watching it. Their users are surely not confused about that. So why does Netflix want to present a prediction as a rating? Is it to flatter their users by telling them that the thing that feels instantly gratifying right now is actually an amazing movie? "Hey, great choice. Billy Madison is a five-star movie. What? Why would you feel bad about not watching Raging Bull instead? It's a two-and-a-half star movie at best." In other words, Netflix, like Facebook, like Doritos, is engineering itself for maximum addictiveness without regard for honesty. It will shelter you from even what you know and reassure you that whatever triggers a pleasure response in your brain is the best. Relax and enjoy it. The truth is that we consume easy things a lot more often than we challenging things. It would be exhausting otherwise. But the best things are often the most challenging. We know that, we know that easy movies are just a way to kill time, but Netflix wants to do us the service of helping us forget it, because then we might be 1% more at ease when we watch Netflix and 1% less likely to switch to another service.
- fitzroy 9y agoI have to wonder if Netflix did this because a lot of their original or exclusive content seems to debut to mediocre star ratings. When the new system says "x% match" I assume that value is derived more from genre match or search relevance than whether I'll actually like it or not.
- fritzw 9y agoI think Netflix probably did it because people are inherently bad at being objective. For the average person, 2 stars for a movie and 4 for another isn't based on anything measurable, even they couldn't explain. I'm shocked at some of the amazon product reviews, most of which are 5 star reviews even if the product is absolutely terrible. Movies are different than products, but it's the same people doing the reviewing. Remember, the average user is not a thinking analytical HN user. Average people are much better at bool choices. Whether the buttons do anything, I have no idea
- ballenf 9y agoI know I'm in the minority here, but I am a big fan of the new system. I would torture myself trying to decide between, e.g., 3 or 4 stars for movie. And then go back and re-rate other movies that I realized I liked more but rated lower than the just-rated movie. Their % match numbers are fairly accurate, but I have had to go into the watch history and delete the occasional movie watched and finished that we actually hated. No number of 1-stars (or thumbs downs) would eradicate its effects on the recommendations.
- jimbobimbo 9y agoMy system was (and is, in DVDs): 5 - Absolutely loved it, will buy a disc 4 - Good, but won't buy a disc 3 - Movie was okay 2 - Not a good movie 1 - Stopped watching 20 minutes into it My problem with binary choice is that 1 == 2 and 3 == 4 == 5, whilst 1 and 5 were very special for me. :(
- thinkingemote 9y agoWith stars you can cross compare with others to see if they have the same score. With simple thumbs up recommendations you cannot compare the ratings as the score is whether it appears to you or not.
- JacobiX 9y agoPopular recommendation algorithm like collaborative filtering by matrix factorization takes into account the accounts for user and item biases (the simplest method is to normalize the ratings of a particular user by the average of ratings of that user).
- freehunter 9y agoThumbs up/down might not be the best for training a recommendation engine, but as someone who just switched his product's rating system from 1-5 to simple up/down, let me tell you: people have no idea how to use a star rating system. I would get people raving but leave a 1 star review, some people would leave a 5 star review and say bad things, some would leave a 1 star review but seem pretty neutral in their review. A person is smart. People in general are dumb.
- jandrese 9y agoNetflix's recommendation system is only good at recommending Netflix shows now.
- alistairSH 9y agoOr movies I watched last week. Sigh.
- kerbalspacepro 9y agoRegarding Amazon: "Oh, you bought a wallet? Here are twenty wallets of the exact same type but with slightly different colors that you might want to buy, too"
- wlesieutre 9y agoI told this story in the recent Amazon recommendations discussion, but I bought a pair of speaker stands from them and before it was even delivered they sent me an email saying "HEY BASED ON YOUR BROWSING HISTORY MAYBE YOU'D LIKE THESE OTHER 10 SPEAKER STANDS!"
- jon_richards 9y agoI've heard the argument that this prevents buyer's remorse. Not sure if it has any merit.
- differonzi 9y agoWhat are the (general) financial consequences of buyer's remorse?
- njarboe 9y agoFor Amazon with a generous return policy, when a person has buyer's remorse, they can return the item. Lost sale.
- CodeCube 9y agowait, wouldn't this cause buyer's remorse? like, if I just finally decided to buy some product ... being bombarded with all the other options suddenly makes me rethink my purchase decision, "oh but what if this other one is more gooder!?!?!"
- sogen 9y agoExactly my thoughts, you might see there something with better/more reviews.
- softawre 9y agoSteam itself doesn't have filtering like that but third-party sites do. Try: https://steamdb.info/ https://steamdb.info/
- Semaphor 9y agoYeah, I know steamdb. Didn't know they had such a search though and looking there I can't find it, got a direct link?
- unoti 9y ago> for sites like Steam, YT, Netflix I always wish for more tuning parameters because their recommendations are all horrible. The problem with those recommendation engines is that they're not optimized to serve your needs. They're optimized to serve the goals of their respective companies. And the problem comes when your needs are a little incompatible with the needs of the company. Consider Netflix for example. Their recommendations don't seem to care much about what you actually enjoy the most. They pay different amounts of money to let you watch different content. So your goal of watching the thing you would enjoy the most is different from whatever the hell their goals are-- probably to get you to watch just enough Netflix to make you not want to cancel your subscription, but not run up their bills on bandwidth and licensing fees. I'm absolutely confident Netflix could make amazing recommendations-- and probably already has them internally. But it's not in their best interest to give recommendations that are in your best interest. To the extent that I'm right about this it could be a market opportunity to make an honest and useful recommendation service.
- theseatoms 9y ago> They're optimized to serve the goals of their respective companies. And the problem comes when your needs are a little incompatible with the needs of the company. Ultimate they are compatible though. And yes I mean in the econ 101 way. This tension should be at least partially resolved via pricing scheme innovation.
- eru 9y agoPricing scheme innovation, and just plain iterated interaction and long term reputation.
- sgustard 9y agoNetflix has a tiny catalog, so investing in making recommendations from that tiny catalog is mostly wasted. Half of Netflix's business now is House of Cards, so their entire algorithm consists of recommending House of Cards to people who haven't watched it yet, and random content to the others.
- chiefalchemist 9y ago
- chiefalchemist 9y agoAll the technology hype aside, it often feels as if these feed prediction algorithms are akin to weather forecasting. That is, there not forecasting per se, but taking educated guesses based on some set of knowns. The problem is correlation is not cause.