No you don't. If your protocol involves peeking (and early stopping), you need different thresholds to declare statistical significance. But you can do that. Yo

No you don't. If your protocol involves peeking (and early stopping), you need different thresholds to declare statistical significance. But you can do that. You just need to know whether you're peeking or not, which everybody does.