5 ms·
Purely anecdotally, the one place I worked at that embraced A/B testing went to such an extreme that it stifled the vision. It became so risk averse that nothin
by ljm 8y ago
Purely anecdotally, the one place I worked at that embraced A/B testing went to such an extreme that it stifled the vision. It became so risk averse that nothing was really happening, yet at the same time the business was not in the place to sustain growth or even profit that way.
This is because the introduction of such a data driven mentality meant the only people empowered to suggest decisions or experiments or approve the work were all in marketing. Because they were basically deciding what workload they wanted and of course you won’t put more on your plate if you don’t have to.
This isn’t to say it’s about data vs. vision. The original success is usually created in large part due to a healthy collaboration between the visionaries, the engineers, and whoever else is in the mix. Once you take one part of the team out of the equation and tend too heavily towards a particular bias then you might well have lost the secret to the initial success.
- jsonne 8y agoYour experience is similar to mine. I'm a marketing consultant so I get to work with a lot of different teams. People that either over-rely on Founder vision AND people that overly rely on data tend to not do well. It's why I've stopped saying data-driven and now say data informed. The best teams have a solid vision, but let the data guide the specific implementation of said vision. You need a healthy mix of both.
- dwaltrip 8y agoI really like "data-informed" as an alternative to "data-driven". I'm going to copy that! It is important to honestly acknowledge the limitations of the data.
- jiveturkey 8y agome too