Before you get too far, try an A/A test. By this, I mean let the A and B choices be identical. You would certainly expect the outcomes to be equal. Right? I

Before you get too far, try an A/A test. By this, I mean let the A and B choices be identical. You would certainly expect the outcomes to be equal. Right? I have seen statistically significant differences in outcomes in A/A testing. A/B testing has value but being sure to A/A test may temper your expectations and/or point at problems in your setup before you get too far.