3 ms·
Absolutely. A/B testing causes way more bad decisions than good ones because people run the tests wrong and they interpret the data wrong. But I've found expl
by the-pigeon 7y ago
Absolutely.
A/B testing causes way more bad decisions than good ones because people run the tests wrong and they interpret the data wrong.
But I've found explaining that to people to be an uphill battle. They get sold on an "objective" way to optimize the UI and then don't want to hear that the method is actually very subjective when not done correctly. And it's hard to execute and interpret correctly so every A/B test I've seen ran has been very subjective.
- pvorb 7y agoHaha. So I'll do better than the average company doing A/B testing by simply avoiding the methodology altogether? That's nice to know.
- the-pigeon 7y agoI'm a huge believer in the "expert product manager" route. Meaning have one person who talks to all the stakeholders and every type of user. Who just knows your product backwards and forwards. And thus can drive what changes you need to make to push things forward. What exactly the means depends on the nature of the product.