That would be best practice if you insist on using null hypothesis significance testing and only wanted to use classical frequentist statistics. We really can d

That would be best practice if you insist on using null hypothesis significance testing and only wanted to use classical frequentist statistics. We really can do much better these days with multi-armed bandits, and by focusing on effect sizes and credible intervals rather than a yes/no answer to a hypothesis.