3 ms·
As always, test test test. I tried this for BCC, repeatedly, and never got it to work. Also as always: do not assume that you're seeing the result of any one
by patio11 16y ago
As always, test test test. I tried this for BCC, repeatedly, and never got it to work.
Also as always: do not assume that you're seeing the result of any one element unless you are testing that element in isolation. You might think the lightbox element is the most prominent aspect, but the call to action also changed from "Start Optimizing Your Website" to "Create A/B Test ->"
You see that arrow there? That arrow, tested in isolation, has been worth 10% to me before in some circumstances. Yeah, it blows my mind, too. And there were many other things that changed.
- paraschopra 16y agoInteresting, yes. Agreed that there are too many variables which we tweaked. But this was a two stage A/B test so if you remove this popup box and move back to traditional signup form, we saw conversions drop back to normal. May be it was the arrow icon that did the trick but I am not complaining since we saw such good increase in conversions! ;)
- ihumanable 16y agoI can't agree more with this. We've run A/B Testing on this kind of modal dialog and we did not see an increase in conversion. In the article too many variables changed at once. Changing the "Watch the Video" button to a "Start Optimizing" button is a huge change in and of itself.
- paraschopra 16y ago>Changing the "Watch the Video" button to a "Start Optimizing" button is a huge change in and of itself. As I wrote in case study, this change did not lead to a significant increase in signups. After we introduced popup signup box, signups increased by 50%.
- koolaidavoider 16y agoNot only that, but do not assume that what works for one audience automatically translates (which is when testing helps). Different websites/products should target differently. So even if this worked for one of your sites, it may not be the best thing to do with another.