> Anyone want to comment on what sort of numbers you should be looking at, roughly, in order to get statistically significant results? This is a very important

> Anyone want to comment on what sort of numbers you should be looking at, roughly, in order to get statistically significant results? This is a very important point. We've found you have to go with your gut until a point. We've just started doing lots of A/B testing for Buffer (http://bufferapp.com http://bufferapp.com). We are now getting 300-500 signups per day, and we currently have around a 10% conversion so you can work out how much traffic that is. We've tried A/B testing in the past without success, and I think now is the right time for us with the right volume for A/B testing to have a significant impact. One important thing: we've started A/B testing aggressively (a new test almost daily, now onto our 4th test. We've tested 3 different variations and had no significant results. I expect this to take a long time, and posts like this make it seem easy to get significant changes in conversion. A/B testing is hard.