5 ms·
When you collect data if it doesn't reflect what you know about reality, check again how you are collecting data. If citizens no longer think reporting a crime
by djtango 2y ago
When you collect data if it doesn't reflect what you know about reality, check again how you are collecting data.
If citizens no longer think reporting a crime will lead to justice, will they still report crimes?
My lived experience is that London is not as safe as it used to be. If the data tells me otherwise I will tell you a KPI driven org is gaslighting me
- Larrikin 2y agoWhat if it's just someone lying on the internet.
- djtango 2y agoI don't live in NYC so I can't comment on what happens in NYC but when people point at data and blame social media for altering perceptions I find it disingenuous for my lived experiences in London. You only truly realise how unsafe London is after you leave and live somewhere that is safe.
- llamaimperative 2y agoThe reason we use data is because we’ve discovered, over and over, that people’s “lived experience” is actually unreliable. Anyway obviously there’s more crime than ends up being reported, but less than people’s worst estimates.
- nla 2y agoWhere'd my little cupcake go?
- jakubmazanec 2y ago> I will tell you a KPI driven org is gaslighting me That's still just the same old issue aggregate statistics vs. a data point. They tell you something, on average, is this way, but you experienced it in another way, so you say "the statistics must be wrong". > you know about reality So the issue is: is your model of "reality" the correct one?
- Eddy_Viscosity2 2y agoThe discussion thus far has been about the incentivized manipulation of the data points as they come in. Aggerating those into statistics will produce misleading and incorrect results. Its not that an an individual data point can be different than the average, its that the flow of individual data points into the average is being 'managed' as people try to 'improve' these KPIs.
- jakubmazanec 2y agoSure, but is the data collection truly incorrect? He argues that it is because "his experience" doesn't match the data. So in the end it is about data points being different than average.
- Eddy_Viscosity2 2y agoI can't say for sure one way or the other. But my experience has been that people that have KPI metrics to meet will do a lot of things to game those data points to their favor.
- jakubmazanec 2y agoWell, there's also Goodhart's Law [1]. Maybe that's what OP meant to reference. [1] https://en.wikipedia.org/wiki/Goodhart%27s_law https://en.wikipedia.org/wiki/Goodhart%27s_law