3 ms·
I think the take-home here is summarized here: This imagined paradox is caused when the percentage is provided but not the ratio. In this example, if only the
by r00fus 15y ago
I think the take-home here is summarized here:
This imagined paradox is caused when the percentage is provided but not the ratio. In this example, if only the 90% in the first week for Bart was provided but not the ratio (9:10), it would distort the information causing the imagined paradox. Even though Bart's percentage is higher for the first and second week, when two weeks of articles is combined, overall Lisa had improved a greater proportion, 55% of the 110 total articles. Lisa's proportional total of articles improved exceeds Bart's total.
So it's important to not rely on percentage data alone, as it is a form of reduction. Rely instead on ratios, allowing you to see the validity of the percentage.
On Amazon and review sites, when I search by rating, I always look at the number of reviews and weight accordingly. I remember that IMDB (before it became an Amazon property) implemented a beyesian posterior mean to cull out the low-review anomolies: https://secure.wikimedia.org/wikipedia/en/wiki/Internet_Movie_Database#Ranking_.28IMDb_Top_250.29 https://secure.wikimedia.org/wikipedia/en/wiki/Internet_Movi...
I wish other places like Amazon would implement similar weighting mechanisms to really allow a user to navigate by reviewed quality.
- jodrellblank 15y agoI glance at the 5 star reviews then head straight for the 1 stars. Reviews aren't really ratio based - a single counter of the right kind can completely disuade me. I really don't want "low revie anomalies" culled. I watched the Benoit Mandelbrot TED talk earlier, he had a graph of S&Ps stock market index normally compared to it win the five most anomalous daily trades removed - it was very different. Stock market models, he said, try to smooth out the rough bits which are hard to handle, but that's really where the meat is.
- r00fus 15y agoSorry, when I said low-review anomalies, I'm talking products that are not reviewed enough (i.e., 5-star from a single review). They likely give an inaccurate view of the product. Comparing two separate products, of which one has 100 reviews and another has 7, I'll take the 100-review rating as more "interesting" than the 7-review product, even though the 7-review item maybe rated higher.