sokoloff makes a great point. Something I learned from years as a QA lead: always ask that every test you do has a failure and a success case. Surprisingly oft

sokoloff makes a great point. Something I learned from years as a QA lead: always ask that every test you do has a failure and a success case. Surprisingly often, the tests that show your program works fine aren't actually doing their job properly, so they also need to be checked. In other words, testing your implementation of A/B testing is a Good Thing. Even if you don't understand that statistics behind it, at least you can see the same variance occurs in A/A testing, which tells you to go read up some more on what you're doing wrong.