2 ms·
Seconding this, the number of e-commerce companies who got "A/B testing into bankruptcy" on my memory approaches 20. My take on this. Even in cases where such
by baybal2 8y ago
Seconding this, the number of e-commerce companies who got "A/B testing into bankruptcy" on my memory approaches 20.
My take on this. Even in cases where such testing was done by disciplined statisticians (which is not the case in at least 9 times out of 10. Yes, a math or cs PhD major is not a professional statistician by any stretch,) the value of advice made from that data is marginal at best.
As eCommerce is bread and butter of cheap electronics industry, I saw times and times again that "science driven" outfits loose out to others. Not so much because of their quality of decision making was demonstrably inferior, but because their obsession with "statistical tasseography" drained their resources, and shifted their focus away from things of obvious importance.