6 ms·
That all depends on what the results of that A/B test were. If it was a 50% increase in signups over a set of 1000 cases, I’d be inclined to say it’s statistic
by Aeolun 8y ago
That all depends on what the results of that A/B test were.
If it was a 50% increase in signups over a set of 1000 cases, I’d be inclined to say it’s statistically significant.
- TeMPOraL 8y agoThat's assuming they tested for one masked/non-masked input only and not bundled it with other redesigns, or didn't have other confounders like a sale, or marketing campaign, etc. Also that they did run this as a trial for set amount of time, and not until Optimizely told them that the B-version is outperforming A-version (common A/B testing pitfall). Overall, seeing the UX crap produced by many data-driven companies (Google included), I have low trust in their methodology.