3 ms·
> five star rating systems suffers from massive score inflation Indeed. I liked how Goodreads had their original rating scale done: 3 was good, 4 was very goo
by bostik 8y ago
> five star rating systems suffers from massive score inflation
Indeed.
I liked how Goodreads had their original rating scale done: 3 was good, 4 was very good, and 5 was truly exceptional. You weren't supposed to give 5 to more than maybe 2% of the books you'd read.
Then the got bought out (by Amazon) and the scale got soon enough devalued.
I still think that one potential solution to the scale inflation would be to consider the grade distribution a person uses. If all they give out is ones or fives, their reviews should have near zero weight. If they give out a more balanced (on a ~Gaussian curve) reviews, then their rare extremes should be weighted much higher.
- dswalter 8y agoYour idea is along the lines of 'rater reliability' in the field of educational measurement/psychometrics.
- tomjen3 8y agoHonestly just make it thumbs up or thumps down. Five star ratings are quite pointless.
- supertrope 8y agoI like Rotten Tomatoes's system. Individual critics give a thumbs up or down. A movie is "certified fresh" if at least 80% think it was worth watching. It doesn't mean the average rating was 80% or that that number means it was amazing or excellent, it just means the vast majority thought it was worth your time and money.