2 ms·
"we know that a higher rating is better." Typically, you do not know that, especially if you are comparing across reviewers. Some will only score zero and 5 st
by Someone 15y ago
"we know that a higher rating is better."
Typically, you do not know that, especially if you are comparing across reviewers. Some will only score zero and 5 stars, other will have 10% two stars, 80% three stars, and 10% four stars, yet others will have 10% three stars, 80% four stars, and 10% five stars.
If you have sufficient data (rare), it may be possible to (somewhat) correct for that. IIRC, this was something that helped in winning the Netflix challenge.
For example, http://www.netflixprize.com/assets/GrandPrize2009_BPC_PragmaticTheory.pdf http://www.netflixprize.com/assets/GrandPrize2009_BPC_Pragma... models the assignment of stars as two parts:
- modeling the user's appreciation of the movie
- modeling how the user translates his appreciation to a star rating
"where we know that a higher rating is better but assume nothing beyond that"
Problem with that is that you throw away information with that assumption. You do know that 2 star scores are very unlikely to be about very good items.