4 ms·

A/B testing is one of those things that, as an engineer, for me it's very tempting to just write it myself. I've tried a couple of solutions: - Split Test Acce

A/B testing is one of those things that, as an engineer, for me it's very tempting to just write it myself. I've tried a couple of solutions: - Split Test Accelerator may actually have been written by a monkey who was accidentally taught PHP, judging from the code. - Google Web Optimizer seems to have been written as an afterthought, judging from the simple nature of the tools you get. When I last used it, it was actually just Javascript which you include, that on loading it simply does a search and replace of elements. Sure, it gets the job done, but as a somewhat savvy user, that approach doesn't leave me feeling confident in it. I don't know what mechanism Optimizely uses to execute tests but it seems similar to the Google way -- which I admit is the only way I could think to do remotely hosted A/B testing like this. Optimizely looks a little better in that they host the assets you might want to test. I welcome anyone who wants to build a solution that doesn't seem like it's bolted on.

slewis 16y ago
Try it.
patio11 16y ago
I recommend doing this for anyone whose development platform of choice doesn't have an existing decent A/B testing option. You can do much, much better as a developer with something that has tight integration on the backend. That said, Visual Website Optimizer / Optimizely are godsends for non-technical stakeholders like the marketing department at Random Insurance Company who want to be able to split test without getting into an argument over getting engineers assigned every single time. There's enough of a market there for both of them to do quite well indeed.
- avichal 16y ago
  You hit the nail on the had. I think the much larger market is the non-technical user. Most "business people" (for lack of a better term) want access to lots of data to drive their key metrics. But being blocked on an engineering team to make and push changes to a website is a huge barrier to it ever happening. A/B testing for marketers instead of engineers is a killer value to offer to a business.

slewis 16y ago

Try it.

patio11 16y ago

I recommend doing this for anyone whose development platform of choice doesn't have an existing decent A/B testing option. You can do much, much better as a developer with something that has tight integration on the backend. That said, Visual Website Optimizer / Optimizely are godsends for non-technical stakeholders like the marketing department at Random Insurance Company who want to be able to split test without getting into an argument over getting engineers assigned every single time. There's enough of a market there for both of them to do quite well indeed.

avichal 16y ago
You hit the nail on the had. I think the much larger market is the non-technical user. Most "business people" (for lack of a better term) want access to lots of data to drive their key metrics. But being blocked on an engineering team to make and push changes to a website is a huge barrier to it ever happening. A/B testing for marketers instead of engineers is a killer value to offer to a business.