2 ms·
The amount of A/B or other systematic testing in the news industry is...well, a bit behind par compared to the tech industry. So Brian's work is probably one of
by danso 13y ago
The amount of A/B or other systematic testing in the news industry is...well, a bit behind par compared to the tech industry. So Brian's work is probably one of the most methodological studies done within a news organization.
Yes, it is true that media companies have long been obsessed with ratings and circulation figures, but these numbers have been, IMO, pretty "fuzzy." Before the Internet, there were also audience surveys and tests that purportedly tracked how readers progressed through headlines and stories...but how could such measurements be precise without computers?
Even on a news website, the testing is not so straightforward. Does one story get more eyeballs than the other because of a great headline, placement, wording of a tweet, use of a graphic? Or did it get more eyeballs because it was of a particularly salacious or notorious event? Since the number of stories that a news site can produce in day is relatively small...around 100 to 1000...and the number of variances between topic, length, media assets, time of day, is so large...I think Brian's analytical strategy was pretty keen.
Anyway, here are the original links from his blog. I think there as thorough of analyses as you'll find in other domains:
http://brianabelson.com/open-news/2013/03/18/A-Metric-For-News-Apps.html http://brianabelson.com/open-news/2013/03/18/A-Metric-For-Ne...
http://brianabelson.com/open-news/2013/11/14/Pageviews-above-replacement.html http://brianabelson.com/open-news/2013/11/14/Pageviews-above...