5 ms·

I've often wondered about this. I always suspected online reviews would tend to skew high. I think there's a couple of factors at work. First, people are prett

by imgabe 17y ago

I've often wondered about this. I always suspected online reviews would tend to skew high. I think there's a couple of factors at work. First, people are pretty good at predicting if they'll like something. If it looks like they're not going to like a movie, they don't watch it. Hence, the majority of people who review something, are people who expected to like it. Second, 5 star reviews are kind of pointless for something like cotton balls or artificial sweetener. Either you got the product and it's the right thing in the quantity you wanted, or it's not. There's not a lot of room for subjective discrimination between one box of Splenda and another. Since the product lived up in every way to your expectations, there's really no reason to give it less than full marks.

ugh 17y ago
To your second point I would just like to add that such a skewed distribution of reviews is actually not so much a problem. Most dog foods will get five stars because they just do their job. And only a few don’t, hence the skewed distribution. But the customer has no problem at all to avoid bad products. If anything such a clear dichotomy should make it rather easy. (Just one little theory of mine: I think star reviews don’t work anymore when it comes to more complex [say, than dog food] things. For those you need to read the written reviews and ignore stars. [And maybe look at the distribution. Finding out that a product is polarising and the reasons for that can be helpful.] If someone rates a camera with one star because it doesn’t film 1080p [a perfectly valid complaint] I don’t care much for his opinion because of different preferences. His written information is nevertheless helpful [I could, after all, care for 1080p], but the information conveyed in his one star rating is close to zero.)
- warp 17y ago
  I wouldn't say ignore the stars, but use them as a filter. Read only the negative reviews. Any 5 star review is just a rabid fan, you can safely ignore those. 4 star reviews might be more interesting, but the real content is in the 1, 2 and 3 star reviews. Whatever issues those people have with the product might be genuine issues which you would also not be happy about, or the issue might be something you wouldn't mind. I've bought products based on negative reviews purely because whatever the reviewer didn't like about it, it was something I know I would like. Usually though the reviews won't tell you whether a product is any good, but assuming there are enough reviews on a product the reviews will allow you to determine that certain products really are crap.
  - ugh 17y ago
    This is exactly what I do. I just do that without thinking, so I didn’t even think to mention it :) 5 star reviews are usually boring. Not better than reading the PR blurb.
  - percept 17y ago
    Me too, especially on Amazon. However you might discount the 1-star reviews for the same reason as the 5-star ones. Give me a good 2-star rating any day--1s and 5s are easy but it takes thought to come up with a 2. ;) Incidentally, I was thinking of replacing my old phone and started reading the negative reviews on Verizon's site. Apparently there's no such thing as a reliable phone that's good at making calls (wish somebody would invent one).
    - chronomex 17y ago
      Apparently there's no such thing as a reliable phone that's good at making calls I have one. It's 50 years old and plugs into the wall. :)
      - percept 17y ago
        You mean while it's recharging? ;) My grandparents had this old rotary dial phone, it was black (available in one color!), metal and heavy, really built like a tank. The dial itself was metal and hard to move, and the finger holes weren't beveled so they were sharp and it actually hurt a little to dial the phone. Eventually they ordered some new service and Bell (remember?) made them turn in the phone.
  - dkarl 17y ago
    Read only the negative reviews.... the real content is in the 1, 2 and 3 star reviews. I always feel sad rating a movie three stars for "Liked it" on Netflix, because I know that Netflix's rating system is incompatible with the way people assign ratings. Any rating system has to assume that less than half the rating system will be used for neutral-to-positive reviews, and the rest of the system is a big wasteland of varying degrees of "This sucks!" I know the recommendation system doesn't care whether I mean three stars to be positive or not, but it still bothers me. Is this just an American thing related to the hundred-point scale used in schools, where 69/100 is a failing grade? Or is it universal?
electromagnetic 17y ago
I agree to some point, but quality can have an effect. I remember buying cotton swabs in France that were amazing quality (there were none with bare ends, they were rigid enough to actually swab and they came in a convenient container), however ones I bought from Walmart for the same price (converted, not face value) were god awful in quality (easily 5% were bare ended, they were made of the cheapest thinnest plastic tubes that were less rigid than a bendy straw and couldn't swab at all and came in a cheap plastic bag). I suppose these aren't the things usually purchased online though. Having actually worked as a video game/movie reviewer, I've rarely bought or seen a movie that I knew I wouldn't like. I'm even cunning enough to get out of having to go see chick flicks with my wife (most of the time, but that doesn't spare me from rentals and TV runs). However, I believe from being immersed so much for several years I've got the ability to see through market hype and know before hand what's going to suck, for instance I'm already trying to find a way to avoid seeing 2012.

by imgabe 17y ago

ugh 17y ago

To your second point I would just like to add that such a skewed distribution of reviews is actually not so much a problem. Most dog foods will get five stars because they just do their job. And only a few don’t, hence the skewed distribution. But the customer has no problem at all to avoid bad products. If anything such a clear dichotomy should make it rather easy. (Just one little theory of mine: I think star reviews don’t work anymore when it comes to more complex [say, than dog food] things. For those you need to read the written reviews and ignore stars. [And maybe look at the distribution. Finding out that a product is polarising and the reasons for that can be helpful.] If someone rates a camera with one star because it doesn’t film 1080p [a perfectly valid complaint] I don’t care much for his opinion because of different preferences. His written information is nevertheless helpful [I could, after all, care for 1080p], but the information conveyed in his one star rating is close to zero.)

warp 17y ago
I wouldn't say ignore the stars, but use them as a filter. Read only the negative reviews. Any 5 star review is just a rabid fan, you can safely ignore those. 4 star reviews might be more interesting, but the real content is in the 1, 2 and 3 star reviews. Whatever issues those people have with the product might be genuine issues which you would also not be happy about, or the issue might be something you wouldn't mind. I've bought products based on negative reviews purely because whatever the reviewer didn't like about it, it was something I know I would like. Usually though the reviews won't tell you whether a product is any good, but assuming there are enough reviews on a product the reviews will allow you to determine that certain products really are crap.
- ugh 17y ago
  This is exactly what I do. I just do that without thinking, so I didn’t even think to mention it :) 5 star reviews are usually boring. Not better than reading the PR blurb.
- percept 17y ago
  Me too, especially on Amazon. However you might discount the 1-star reviews for the same reason as the 5-star ones. Give me a good 2-star rating any day--1s and 5s are easy but it takes thought to come up with a 2. ;) Incidentally, I was thinking of replacing my old phone and started reading the negative reviews on Verizon's site. Apparently there's no such thing as a reliable phone that's good at making calls (wish somebody would invent one).
  - chronomex 17y ago
    Apparently there's no such thing as a reliable phone that's good at making calls I have one. It's 50 years old and plugs into the wall. :)
    - percept 17y ago
      You mean while it's recharging? ;) My grandparents had this old rotary dial phone, it was black (available in one color!), metal and heavy, really built like a tank. The dial itself was metal and hard to move, and the finger holes weren't beveled so they were sharp and it actually hurt a little to dial the phone. Eventually they ordered some new service and Bell (remember?) made them turn in the phone.
- dkarl 17y ago
  Read only the negative reviews.... the real content is in the 1, 2 and 3 star reviews. I always feel sad rating a movie three stars for "Liked it" on Netflix, because I know that Netflix's rating system is incompatible with the way people assign ratings. Any rating system has to assume that less than half the rating system will be used for neutral-to-positive reviews, and the rest of the system is a big wasteland of varying degrees of "This sucks!" I know the recommendation system doesn't care whether I mean three stars to be positive or not, but it still bothers me. Is this just an American thing related to the hundred-point scale used in schools, where 69/100 is a failing grade? Or is it universal?

electromagnetic 17y ago

I agree to some point, but quality can have an effect. I remember buying cotton swabs in France that were amazing quality (there were none with bare ends, they were rigid enough to actually swab and they came in a convenient container), however ones I bought from Walmart for the same price (converted, not face value) were god awful in quality (easily 5% were bare ended, they were made of the cheapest thinnest plastic tubes that were less rigid than a bendy straw and couldn't swab at all and came in a cheap plastic bag). I suppose these aren't the things usually purchased online though. Having actually worked as a video game/movie reviewer, I've rarely bought or seen a movie that I knew I wouldn't like. I'm even cunning enough to get out of having to go see chick flicks with my wife (most of the time, but that doesn't spare me from rentals and TV runs). However, I believe from being immersed so much for several years I've got the ability to see through market hype and know before hand what's going to suck, for instance I'm already trying to find a way to avoid seeing 2012.