4 ms·
Good point. There's huge praise when an A/B test shows positive results. "Ship it, we've made the world better!" So that feedback loop is going to incentivize
by ec109685 5y ago
Good point. There's huge praise when an A/B test shows positive results. "Ship it, we've made the world better!"
So that feedback loop is going to incentivize short term thinking and small changes that might not be beneficial to the whole.
- oakfr 5y ago"it's only +0.65% clicks but zero is outside the confidence interval! let's ship it! ten more like these and we've reached our quarterly target!!"