3 ms·
These results seems quite suspicious to me. In all instances the author only received 1 email in reply. If you run these results through an A/B testing calculat
by goldemerald 6y ago
These results seems quite suspicious to me. In all instances the author only received 1 email in reply. If you run these results through an A/B testing calculator, they aren't statistically significant. That's even the case for the 1% conversion compared to the shortest email 8% conversion. I like the thesis statement that short emails convert users better, but the experimental results certainly aren't strong enough to support that claim. I'd love to see an updated version of the article now that 3 years have passed and see what the conversion rate is.
- leegraham 6y agoMaybe I misunderstood the article, but my impression is that the ‘ 4% (1 in 25 users)‘ is just to make the percentages more understandable and the author didn’t only send the email to 100/25/12 users.
- gk1 6y agoThat's correct. I'm editing it to say "1 of every 25 users" to make this less confusing. The actual sample size was quite large.