4 ms·
In what way would this influence things? Sure, it might draw some additional uninterested visitors, but that will just depress conversion rates all around, not
by JoachimSchipper 16y ago
In what way would this influence things? Sure, it might draw some additional uninterested visitors, but that will just depress conversion rates all around, not exclusively for A or B. The results remain valid.
- paraschopra 16y agoYes but that changes the real difference between conversion rates of A and B. Even though trend won't get affected but actual numbers will. Not that serious but given that this problem is easily avoidable one may want to not announce the test.
- fierarul 16y agoAssuming no actual possible customer reads this blog, this doesn't influences the number of new customers, but it does changes the overall numbers. But, if people know they are being A/B tested, this allows them to make a decision about what they think they prefer. Sometimes what people think and are willing to vote (say, by complaining they don't like their option, or by buying a product to support it) isn't what they would have actually picked.