4 ms·
AFAIK (it's been over a year), they use intent to treat approach, and only remove users from the experiment after they have already been matched to an ad. This
by disgruntledphd2 7y ago
AFAIK (it's been over a year), they use intent to treat approach, and only remove users from the experiment after they have already been matched to an ad. This allows them to ensure that the users are matched in terms of expected conversion rate, which allows for valid results.
I believe that there were rumours of using bayesian analysis in the future, but I believe it's a two-sided p-value based on the differences in your chosen outcome.
Reasonably simple, and mostly effective.