4 ms·

The definite answer can be had using a multivariate test with button style and text. But I doubt that style here would be a major influencer because landing pag

The definite answer can be had using a multivariate test with button style and text. But I doubt that style here would be a major influencer because landing page focussed all attention of the visitor on the button. So, visitors would have definitely not missed noticing the button (which is the primary role of button style). Button text would make them decide whether to take next action or not. EDIT: clarified

revorad 16y ago
But how do you know it's the text of the button and not the style which increased conversions?
- paraschopra 16y ago
  I agree that, in theory, button style could have influenced conversions and a follow up test would definitely prove this conclusively.
revorad 16y ago
Given that you were able to increase CTR, I don't know how you can be so sure that visitors were not missing noticing the button. And even if you had good reason to believe that, why didn't you just change the button text instead of replacing it with a new button? Sorry, I'm probably coming across as nitpicking, but I'm just trying to understand how people use A/B testing.
- paraschopra 16y ago
  No, you are totally right. The way you describe is how an actual A/B test should be done. But in practice companies resort to making changes in A/B test which involve changing more than one variable (in this case button style and text). That's because they can't afford the time and traffic it will take to methodically test one factor at a time. Also, primary motivation for many companies is to increase conversions. Knowing and deducing what increased conversions is a secondary priority. By the way, I did not do this A/B test. I just interviewed one of my customers who did this test.
  - revorad 16y ago
    Ah, now I get it. Sorry, for some reason, I assumed you did the test for the customer. I shouldn't doubt your A/B testing ninja skills. The button test, even combining style and text, is still quite a small change to test. Don't your customers want to test more drastic changes?
    - paraschopra 16y ago
      Yes, they do. See our case study library (we have more than 15 A/B tests): http://visualwebsiteoptimizer.com/case-studies.php http://visualwebsiteoptimizer.com/case-studies.php

revorad 16y ago

But how do you know it's the text of the button and not the style which increased conversions?

paraschopra 16y ago
I agree that, in theory, button style could have influenced conversions and a follow up test would definitely prove this conclusively.

revorad 16y ago

Given that you were able to increase CTR, I don't know how you can be so sure that visitors were not missing noticing the button. And even if you had good reason to believe that, why didn't you just change the button text instead of replacing it with a new button? Sorry, I'm probably coming across as nitpicking, but I'm just trying to understand how people use A/B testing.

paraschopra 16y ago
No, you are totally right. The way you describe is how an actual A/B test should be done. But in practice companies resort to making changes in A/B test which involve changing more than one variable (in this case button style and text). That's because they can't afford the time and traffic it will take to methodically test one factor at a time. Also, primary motivation for many companies is to increase conversions. Knowing and deducing what increased conversions is a secondary priority. By the way, I did not do this A/B test. I just interviewed one of my customers who did this test.
- revorad 16y ago
  Ah, now I get it. Sorry, for some reason, I assumed you did the test for the customer. I shouldn't doubt your A/B testing ninja skills. The button test, even combining style and text, is still quite a small change to test. Don't your customers want to test more drastic changes?
  - paraschopra 16y ago
    Yes, they do. See our case study library (we have more than 15 A/B tests): http://visualwebsiteoptimizer.com/case-studies.php http://visualwebsiteoptimizer.com/case-studies.php