3 ms·

It's hard to have a truly controlled experiment though. The result will be valid for that farm, on that year - but next year the conditions will be different, e

It's hard to have a truly controlled experiment though. The result will be valid for that farm, on that year - but next year the conditions will be different, etc.

Kamq 4y ago
That's true of all A/B testing for real world things isn't it? You could have measured increased traffic because something was trending on twitter/HN instead of the UI changes you just deployed. Might be completely different tomorrow.
jeltz 4y ago
That is true for A/B tests too in tech.