That's precisely where Norvig is coming from. Given their infrastructure, it's entirely possible that some portion of their A/B testing is run this way (i.e.,

That's precisely where Norvig is coming from. Given their infrastructure, it's entirely possible that some portion of their A/B testing is run this way (i.e., test thresholds chosen to maximize information gain).