4 ms·
If you want to some actual examples of how optimization based on data can be harmful, I suggest reading Seeing Like a State. If more people that made decisions
by _Algernon_ 2y ago
If you want to some actual examples of how optimization based on data can be harmful, I suggest reading Seeing Like a State. If more people that made decisions based on data read this book, the world would be a better place.
The TL;DR is that data about a system does not reflect the underlying system perfectly, and thus is a distortion of the real system. Decisions based on this distorted data can be equally distorted, sometimes dangerously so.
For software telemetry for instance, telemetry only gives the "what", not "how"
eg. feature X is not used.
Possible explanations:
- Not useful to users -> Probably should be removed.
- Not discoverable -> Probably should be kept and made more discoverable.
- Difficult to use -> Probably should be kept and made easier to use.
Most times (I'm looking at you here Mozilla and every commercial software provider ever) people take the shortcut of assuming the first explanation and removing it prematurely.
- yencabulator 2y ago- "Users interact with feature Z a lot" -> "our users love feature Z" OR - "Users interact with feature Z a lot" -> "Z is very hard to use and requires lots of fiddling"
- TeMPOraL 2y agoPossible extra explanation: - You've forgotten the denominator Features A and B may be equally important, but B may be applicable only in specific circumstances. If you'd compare A and B on the metric of "how often it's used", you may see B being used much, much less than A, but that's not reflective of the feature, but of the job being done.