3 ms·

It sounds like you think that the reported results of these A/B tests are snake oil, not A/B testing itself. I think most authors of A/B-testing-report articles

by mileszs 16y ago

It sounds like you think that the reported results of these A/B tests are snake oil, not A/B testing itself. I think most authors of A/B-testing-report articles would recommend testing such changes yourself, as opposed to accepting their findings as fact for every site in existence. Those who said the popup forms did not work for them only know that because they A/B tested them. I think a healthy conclusion is "this worked for us, so it might be a good idea, but you should test it for your site". Wouldn't you agree?

Tichy 16y ago
Yes and no - you can not test it all, there might be a point of diminishing returns after a certain level of optimization that has gone into a site. Just as with SEO - SEO is not completely useless, yet there are people who promise too much or even hurt you. I suspect with A/B tests you could also hurt yourself, for example if you measure the wrong thing. I don't know, maybe I am just a little bit tired of all the simplified promises.