5 ms·
I doubt there are companies exclusively rely on A/B tests to make decisions, but even if there were, someone has to think about hypothesis and design the right
by mehrdada 8y ago
I doubt there are companies exclusively rely on A/B tests to make decisions, but even if there were, someone has to think about hypothesis and design the right experiment to then confirm with data. You can't just have a computer running around and make experiments and confirm them for youº.
--
º: you kind of can, if you have enough fresh data, to search for and derive statistically significant results automatically.
- blobster 8y agoMaybe it's just me, but I don't think the secret behind this kind of success is just properly designing experiments. Again, if this were true, the best founders would be data scientists. But they're not. They are visionaries. So I reckon it must be the vision.
- morningcovfefe 8y agoVision is obviously necessary - but a big problem folks run into is failing to recognize when something is not working. A/B testing is one way to keep yourself from falling into the trap of thinking 'I know better than my users what they should want'
- blobster 8y agoI agree, but I think this doesn't apply to innovation. When is comes to innovation, people always want faster horses.
- rv-de 8y agothat depends on the validity and accuracy of your test metric.
- TylerE 8y agoAlso a good way to find a local maximum when there are much higher maxima not far removed.
- andrepd 8y ago>Again, if this were true, the best founders would be data scientists. But they're not. They are visionaries. [citation needed]
- lenzm 8y agoYou'd be paralyzed by indecision if every decision had to be driven by the results of a test.