This is adding considerable effort and weight to the process. The alternative is just running the experiment, which would take 10 minutes to set up, and see th

This is adding considerable effort and weight to the process. The alternative is just running the experiment, which would take 10 minutes to set up, and see the results. The A/B test will help measure the qualitative finding in quantitative terms. It's not perfect but it is practical.