4 ms·
> * Was that test just on new users - or subscribers in general? If the latter you're going to self-select for folk who are interested enough in your stuff to r
by gwern 13y ago
> * Was that test just on new users - or subscribers in general? If the latter you're going to self-select for folk who are interested enough in your stuff to read regardless, which will skew the results somewhat.
I don't have 'subscribers' or 'new users'. Just people visiting the site. (I suppose there's people visiting from the RSS feed, but they're well under 1% of page views.)
> you've got a pretty technical audience...I'd be leary of generalising that to other markets.
OP's blog seems rather technical.
> This will make the improvement on larger displays seem less significant.
True, but this still wouldn't explain why the smaller max-widths - the max-widths that would hit the most viewers - would not win.
> * Tests like this can be really skewed if you have audiences that shift device over time
Certainly, but the 2 tests were separated by something like a year. Is it really likely the audience changed in both a/b tests in the same way?
> * The line length is something that has interactions with other typographic features like line spacing and font size. Optimising on one alone can lead to poor results.
Sure, but in the absence of any specific reason to suspect an interaction...