Bold of you to assume that product decisions are based on rigorous statistical tests. Jokes aside, for product decisions (or all kinds of decisions, really) yo

Bold of you to assume that product decisions are based on rigorous statistical tests. Jokes aside, for product decisions (or all kinds of decisions, really) you should differentiate between statistical significance and relevance. A small measured difference in some metric, even if statistically significant to p < 0.000001, may not be relevant for a decision.