4 ms·
It's about damn time. 5-star rating systems are broken. A 1/2/3-star rating is effectively a dislike, and a 4/5-rating is effectively a like. In the big data s
by minimaxir 10y ago
It's about damn time.
5-star rating systems are broken. A 1/2/3-star rating is effectively a dislike, and a 4/5-rating is effectively a like. In the big data sense, a deviation from a 1-star for dislike and 5-star for like is statistically meaningless. (and this is universal; star ratings on Amazon Products and Yelp Locations have the exact same distribution).
The interesting part of this is what Netflix gains from the change, since their recommendation algorithms will become less granular. Maybe they came to the same conclusion?
- wwarren 10y ago> star ratings on Amazon Products and Yelp Locations have the exact same distribution Source?
- minimaxir 10y agoGlad you asked! http://minimaxir.com/2017/01/amazon-spark/ http://minimaxir.com/2017/01/amazon-spark/ http://minimaxir.com/2014/09/one-star-five-stars/ http://minimaxir.com/2014/09/one-star-five-stars/
- e12e 10y agoI actually thought Randy Farmer touched on this in his Google talk on "Building Web Reputation Systems" - but maybe I saw it somewhere else, years ago. Like this: http://www.lifewithalacrity.com/2006/08/using_5star_rat.html http://www.lifewithalacrity.com/2006/08/using_5star_rat.html At any rate I thought it was common knowledge that 5-point ratings have issues - especially as a "social rating system"?
- minimaxir 10y agoUnfortunately, as other comments on this HN submission demonstrate, the 5-star system is sacrosanct and any change, even those made a decade later, is bad.
- Markoff 10y agono, 1 is bad movie, 2.5 is average movie, not bad, not really good, 5 is masterpiece seen once in few years it's sad teenagers who think life is black and white are the ones deciding it for others luckily there is TMDb where i have my watchlist, imported ratings from IMDb and can discuss there each individual movie
- minimaxir 10y ago> 2.5 is average movie That's the other problem: since the breakdowns of ratings are skewed, the average movie (the arithmetic mean) tends to have a rating of ~4 stars. Another reason to get rid of the system.
- dexterdog 10y agoThe problem is that is your opinion of a 5-star system. Everybody approaches them differently. Some people give everything they like 5 stars, everything they kind of like 4 stars and just don't vote on everything else. Some people just do 5 for like and 1 for dislike. The 10-point system on IMDB is even worse.
- meesterdude 10y agobut that's the problem with 5-star systems - everyone uses them differently. Like/dislike leaves little room for ambiguity.
- dexterdog 10y agoThat's what I meant.