3 ms·

I would like to see an A/B test where A is no test and B is a traditional A/B test. ;-) My guess is, similar tests favor the "non-test" or quicker result/load,

• 3pt14159 16y ago
  I did this before, I was making the case that JavaScript run tests took extra time and that server side tests were superior for large companies because they didn't need to call out to a resource outside their network. Sure enough conversions were 9% lower (percent of a percent, so from 2% to 1.82%). The funny thing was that when we tested another one of these JavaScript based split testers it was coincidentally in the same server room as the hosting provider at the time, so it didn't negatively effect the conversion rate. That being said, almost nobody split tests. It's a serious problem because marketing usually needs technical to split test, so even if Optimizely cuts your temporary conversion rate by 9% you will still make that back quickly after a couple of split test iterations. My number one question for optimizely is when are they going to include some sort of call back api or something to track real conversions. The number one concern SaaS businesses have is visitor -> paid account not visitor -> free account or signup screen.