4 ms·

It seems that any kind of data is mainly used to confirm the believes people already had and/or justify decisions already made.

• lewisl9029 5y ago
  Not to mention the decision paralysis and change aversion it often introduces into company culture where every change, however trivial or however obviously beneficial, has to first go through a 2-week A/B test which often turns out to be inconclusive anyways, and sometimes takes more eng resources to set up and run than it takes to make the change itself.
  • ssharp 5y ago
    > however trivial Previous testing should give the company at least some baseline understanding of what is trivial and what isn't. The correct way to experiment is certainly not "let's experiment every idea!" > however obviously beneficial If you've been around long enough, you've almost certainly run into dozens of "obviously beneficial" changes that led to poorer performance. Most of what you're describing is issues with poor prioritization, a lack of understanding about your audience, and a culture that has a difficult time making decisions.