There are lots of risks in A/B testing. Is B a complete failure for some basic UI issue, and you just lost real customers or harmed a relationship? Doing this

There are lots of risks in A/B testing. Is B a complete failure for some basic UI issue, and you just lost real customers or harmed a relationship? Doing this step first is a good way to avoid some of the worst case issues.