Yep. Relatedly, A/B testing is still, in a majority of cases, "run both pages until one shows an x% difference in conversion" WHICH IS TOTALLY TOTALLY BROKEN.

Yep. Relatedly, A/B testing is still, in a majority of cases, "run both pages until one shows an x% difference in conversion" WHICH IS TOTALLY TOTALLY BROKEN. THAT'S NOT HOW IT WORKS. I know people don't really like to remember high school stats, but surely we can get the world to a place where CMOs etc know enough to not do this and not let their teams do this? Or are they incentivised to show that they're "adding value" without really caring about whether that value is real or not?