2 ms·
Some very interesting analysis, and in some ways, it raises even more interesting questions about the sampling at IMDB. Who is filling out IMDB reviews and rati
by jonnathanson 12y ago
Some very interesting analysis, and in some ways, it raises even more interesting questions about the sampling at IMDB. Who is filling out IMDB reviews and ratings? How many segments are there among the raters, and to what extent are they truly representative of the general, TV-watching population?
Looking at the list, for instance, you see that Dragon Ball Z shows up as one of the highest-rated shows of its decade. Now, perhaps a truly randomized, representative sample of the population really would rank Dragon Ball Z as one of the greatest TV series ever made. But my gut tells me that's unlikely. More likely is that a big cluster of fans of the show have self-selected into rating it highly. What you're actually seeing, in this case, is the power of a very vocal, very rabid niche. [1]
This same effect, in reverse, can artificially deflate the ratings of shows and movies that a vocal minority of the population rallies against. This appears to be the case with Gunday, one of the lowest-rated movies on the site, which David Goldenberg of FiveThirtyEight discusses in a very interesting post: http://fivethirtyeight.com/features/the-story-behind-the-worst-movie-on-imdb/ http://fivethirtyeight.com/features/the-story-behind-the-wor...
Finally, we need to filter the data set for size. Ice TV, a show from 1996 with all of 6 ratings on its IMDB page, probably wouldn't pass our gut check for "Best of the 90s," alongside shows like The Sopranos and Friends, which probably got ratings more or less representative of public opinion.
This is a fascinating subject and a really compelling start. But the next step in this sort of analysis is developing a reasonable methodology for parsing and reconciling quality, quantity, and clusters. To give the author due credit, he expresses the appropriate amount of skepticism or reservation when showing results. And his observations about genre and overall trends are fascinating to see.
[1] Of course, this raises some intriguing questions about what, exactly, a "quality" show is. A show that has a large, thriving fanbase is a great show to that fanbase. And to the extent it's attracted a sizable, rabid following, it can probably be said to be a great show in general -- even if it's not everyone's cup of tea. And that's probably fine. Obviously not every show is going to appeal to everyone in the population. Nevertheless, strong-niche shows confound our idea of "generally" great shows and make normative comparisons very hard to do, unless we start factoring for things like strength of sentiment.