3 ms·
Seems it's all too common that those who are watching the metrics, forget that the metrics change.
by runjake 15y ago
Seems it's all too common that those who are watching the metrics, forget that the metrics change.
- joebadmo 15y agoYes, another, maybe even more important point that Christensen makes is that smart people get sucked into these metrics not because they haven't been educated well enough in the tools that business school programs give them, but because they fail to think critically, to ask the right questions, and to form the correct narratives. And this is a criticism that applies not just to business, but to engineering, product development, design, etc. You can be the best problem solver in the world and it won't help if you're solving the wrong problems. And this sort of thinking is something that a broader liberal arts education can at least encourage, which is why I'm still a proponent of the liberal arts, and wish people would find more value in them. (Yes, I was a Comp Lit major.) (Obviously, it has to be a well-executed program in any case, and an unserious student isn't going to learn anything in any case, either.)
- ChuckMcM 15y agoOr to put it slightly differently, the act of measuring a system changes it. Pretty much any system, but for businesses this is especially true. As you measure, you respond to the measurements, and the response ends up being reflected in future measurements. Sometimes the new system created by this feedback path heads off into the hinterlands like a glider flying off the gameboard in Life. A real world example was BYTE magazine. They were polling their readers to see what kind of machine they owned, more and more owned IBM PCs, so they started doing more and more IBM PC articles, which attracted more readers who had IBM PCs. But it left out in the cold people who came to BYTE for non-PC articles (who complained loudly). The key was that the metric 'what computer do you own' did not reflect accurately 'why are you reading this magazine' and yet it was driving what the magazine covered. I'm a big fan of metrics, but I'm also a strong believer in re-assessing periodically how changes in response to a metric have changed the business and measuring that too.
- dredmorbius 15y agoThat's a sampling error / selection bias. The were defining (implicitly) their target market as their existing market. Unfortunately, this was serving not to expand but restrict the interest areas within their existing subscriber base. This is a very common mistake. A canonical example would be the "when should we hold this meeting" question ... asked of a meeting's attendees (the answer will almost certainly be biased toward "when we're holding it now").