8 ms·
I used to joke that Data Scientists exist not to uncover insights or provide analysis, but merely to provide factoids that confirm senior management's prior bel
by slt2021 4y ago
I used to joke that Data Scientists exist not to uncover insights or provide analysis, but merely to provide factoids that confirm senior management's prior beliefs.
I did several experiments, and noticed that whenever I produced analysis that was in line with what management expected - my analysis was praised and widely disseminated. Nobody would even question data completeness, quality, whatever. They would pick some flashy metric like a percentage and run around with it.
Whenever my analysis contradicted - there was so much scrutiny in numbers, data quality, etc, and even after answering all questions and concerns - analysis would be tossed away as non-actionable/useless/etc.
if you want to succeed as a Data Scientist and be praised by management - you got to provide data analysis that supports managements ideas (however wrong or ineffective they might be).
Data Scientist's job is to launder management's intuition using quantitative methods :)
- tpoacher 4y agosadly same with academia and funding sources
- karmajunkie 4y ago"Data launderer" would be a good job title...
- Phrenzy 4y agoThat would imply the data is clean when they are finished. GIGO
- wolf550e 4y agoThe data is not laundered. Preconceived ideas and biases are laundered and given scientific sounding justifications.
- e12e 4y agoConcept Confirmer, Bias Booster?
- barbecue_sauce 4y agoContext Provider.
- e12e 4y agoAffirmation Artificier?
- MonkeyClub 4y agoAssessment Assurance, for double the bang.
- BLKNSLVR 4y agoCherry Picker
- MonkeyClub 4y agoGood role for all Perky Cheekers, surely!
- hermitcrab 4y agoMost data is very dirty.
- ryanwaggoner 4y agoDecision laundering. Take in dirty decisions and produce clean ones.
- yMEyUyNE1 4y agoData Torturer? <https://en.wiktionary.org/wiki/if_you_torture_the_data_long_enough,_it_will_confess_to_anything https://en.wiktionary.org/wiki/if_you_torture_the_data_long_...>
- eska 4y agoThis would match what psychologists say about humans in general: we feel first, then we use our brain to justify that feeling. We’re not rational beings.
- AnIdiotOnTheNet 4y agoWe totally are, it's just that rationality is a tool, not a guide. If you want to work out the truth, rationality will help you do that, but if instead you want to justify a decision you already made, well, it'll help you do that too.
- galangalalgol 4y agoHypothesis don't come from rationality either, they result from well informed intuition. All of the formality of science is about tricking ourselves into discovering our intuition is wrong using a rational series of steps even when everything in our nature is to use that ability to reason to do the opposite.
- ArjenM 4y agoA whole industry of emotional branding is thriving, systematically overloading our brains so it hurt to even think differently in the moment. We are accepting a whole lot of assumptions every day.
- moremetadata 4y agoThats because psychologists dont understand or choose to ignore how chemistry influences our personalities and emotions. An extremely simple example from the same medical/health profession is the use of SSRI's to make people feel happy. The legal system recognises how chemicals influence our feelings because of the laws that exists on illegal drugs or drink driving. The definition of rational is being informed enough to know what said chemicals will do in the short term and long term in order to make an informed decision, but then I'm reminded we dont get taught any of the above unless we specialise at a Uni, so most people cant make any sort of informed decision.
- 4y ago
- zeagle 4y agoHuh. I've not thought of it as laundering, but I think you've basically summarised consulting in healthcare. Pay to legitimize and push through a pre-existing idea (eg let's close down a few ERs) or a delusion (e.g. lean, we don't need a waiting room) and say it was recommended by consultants to stakeholders and the public.
- saltcured 4y agoRight, the more appropriate analogy is "parallel construction"...
- slt2021 4y agoall consulting is like that, Partners/MDs at consulting companies meet with Board/CEOs to get rough idea of what they want/need, and quickly negotiates a consulting engagement contract to create PowerPoint with all the evidence and analysis gathered that supports CEO's initial idea. This is the only reason why a 60+ PowerPoint slide deck can cost several millions dollars
- chongli 4y agoSame goes for economists and the politicians who sponsor them, just as it did for the astrologers and their patron kings.
- BLKNSLVR 4y agoEconomics is the go-to for conservative, status-quo maintaining arguments because there's a wealth of statistics and information available for "how things have always been", and precious little-to-none for "how things could be if..." It's easier to poke holes in predictions of the future than in interpretations of the past, especially when the people making those decisions have likely reached their decision-making status through "how things have always been".
- deleted 4y ago[deleted]
- dukeofdoom 4y agoThat's like a portrait artist that finds success by painting people more beautiful than they really are vs a starving one that paints them true to life due to sense of artistic integrity. Reminds me how Garth Brooks started doing metal after becoming a country music star.
- pjmorris 4y ago> I used to joke that Data Scientists exist not to uncover insights or provide analysis, but merely to provide factoids that confirm senior management's prior beliefs. So, a synonym for 'consultant?' :)
- htrp 4y agoAll symptoms of the same problem..... you can hire McKinsey to confirm your priors, massage the data to confirm your priors, or anything in between.
- happymellon 4y agoMy experience with consultants normally ended up with them asking why they are there and what report should they present to upper management. I've always used them as "independent 3rd parties" who were listened to.
- jacobn 4y agoThis sounds a lot like how my kids will listen to a teacher/coach, but not their parents...
- rxhernandez 4y agoWhich is similar to how a lot of parents won't listen to their kids but will listen to the coach, teacher, or priest.
- mcphage 4y agoMy Mother-in-Law was called by a tech support scammer. Her bank was unwilling to accept their charges, and the scammer wanted her to call the bank to tell them to accept them anyway. My Brother-in-Law was telling her "no, this is a scam, do not do this", but she was unwilling to listen. Eventually, he told her to call me, thinking if she wouldn't listen to her son, maybe she'd listen to her son-in-law. Which she did.
- 4y ago
- monero-xmr 4y agoAlso a big reason McKinsey and BCG exists - provide cover for business plans intended by management to protect them from shareholder lawsuits. My friend did a sojourn at McKinsey and 6 months of his life was producing PowerPoints and memos backing up an expansion to AIPAC region. Was already happening but he was providing all manner of business justification for board meetings and whatnot.
- prometheus76 4y agoI agree with you. I call Data Scientists "soothsayers for the Pharoah".
- m463 4y agoI wonder what a data scientist could really find out about executive (over?) compensation. employee compensation. working from home. office cubicle size and layout. tool expenditure for employees vs productivity.
- ProjectArcturis 4y agoHow would you measure productivity at scale?
- anthonygd 4y agoWell, obviously you ask the CEO.
- timbaboon 4y agoAs a data scientist at a large corporate I find this is often the push… but I resist every time and tell people what they don’t want to hear. Maybe I’m playing this whole corporate ladder thing wrong :/
- throwaway15908 4y agoSounds like a good way to weed out middle management ;)
- adasdasdas 4y agoOh the experiment didn't go as expected? Rerun 5 more times with minor tweaks. It definitely not p-hacking ;).
- data-ottawa 4y agoI’ve been there, we wanted to release a feature, it kept coming back with issues that made it perform much worse than control, after 5 or so iterations with bug fixes it came back positive. It took a lot of analysis and time to clarify to higher ups that we weren’t just P-hacking , but at least they were concerned about that.
- koolba 4y ago> if you want to succeed as a Data Scientist and be praised by management - you got to provide data analysis that supports managements ideas (however wrong or ineffective they might be). > Data Scientist's job is to launder management's intuition using quantitative methods :) It’s no different than the days when grey bearded wisemen would read the stars and weave a tale about the great glory that awaits the king if he proceeds with whatever he already wants to do. The beards might be a bit shorter or nonexistent, but the story hasn’t changed.
- Guthur 4y agoAnd the alternative is to use the data as bones, throw it up in the air and let it tell you what to do?
- bronson 4y agoAbsolutely. If you don't like what K-Means is telling you, change a variable and re-run. (that's one great thing about business data: there's no shortage of variables! True, there's usually a shortage of independent variables, but fixing that is difficult and underfunded).
- red-iron-pine 4y agoAnd you'd better hope the bones actually say something useful. I was the infra lead on a data lake project and got take part all the way to breaking down the data and turning into PowerBI reports. The result was "sell more" and to clients who marketing already identified, years ago, as whales. There were some interesting other insights, esp. w/r/t to niche products that sold around weird dates (Easter, Memorial Day, 4th July -- but not obvious gift days like Valentines or X-Mas), but it led to a lot of "you're doing it wrong!" recriminations and follow up projects.
- somenameforme 4y agoIf you [Croesus] go to war, a great empire will fall.
- remus 4y agoI think this depends a lot on the org. In a place I used to work we collected and analysed a lot of data which convinced management to significantly change the spec of the product and spend a lot more time and effort on testing, because the product was being used in unexpected ways. I would say it was a very engineering driven org however, so if you could present compelling data it could go a long way.
- sidpatil 4y ago> Data Scientist's job is to launder management's intuition using quantitative methods :) https://www.youtube.com/watch?v=kAichhoZrKs https://www.youtube.com/watch?v=kAichhoZrKs
- out_of_step 4y agoThis phenomenon is true to varying degrees in academic medicine (maybe all of academia) as well - personally have seen excellent data and methods disregarded when they don't confirm existing agendas. The choice for the researcher can become one of burning out trying to do good work and getting nowhere, or acquiesce and only present data that is uncontroversial. Huge existential threat to knowledge advancement.
- sva_ 4y ago> I used to joke that Data Scientists exist not to uncover insights or provide analysis, but merely to provide factoids that confirm senior management's prior beliefs. Also someone to blame if it doesn't work out
- alar44 4y agoI mean, that makes sense does it not? If you're confirming something people already had a hunch about, why would they challenge it? And if it does go against their belief, they are going to want to make sure the data is correct before they change the course of the ship.
- xkcd1963 4y agoReminds me of the book "Bullshit Jobs"
- steveBK123 4y agoYes. I worked in the data org of a moderately sized financial firms tech org. The tech org claimed to be hugely data driven. Was in the org mottos and all of that. Nonetheless, the CTO went on a multi-year, 10s of millions of dollars, huge data tech stack & staffing reorg shake up... with really zero data points explaining the driver, or what we would measure to determine it was successful. So it became a self referential decision that we are successful by doing what he decided, and we are doing it because he decided it.
- terry_y_comb 4y agoIndeed, confirmation bias happens to almost everyone.
- dylan604 4y agohow is this really different from any other aspect of life? Very few people really like to be told counter information, and it is always easier when providing data that aligns with the current group think. Doesn't matter if it is business, politics, or really anything. Being the outlier trying to change the direction of things is a struggle.
- peatmoss 4y ago> Data Scientist's job is to launder management's intuition using quantitative methods Ouch. This is savage, but sadly correct in many cases. HOWEVER, to play devil's advocate here, I've also seen corporate data scientists overstate the conclusions / generalizability of their analysis. I've also seen data scientists fall prey to believing that their analysis proves would should be done, rather than what is likely to happen. The role of an executive or decision maker is to apply a normative lens to problems. The role of the data scientist / economist / whatever is to reduce the uncertainty that an action will have the desired effect.
- selestify 4y agoWhat does a “normative” lens mean?
- astine 4y agoAs opposed to "postive". It's the old is-ought dichotomy https://en.m.wikipedia.org/wiki/Is%E2%80%93ought_problem https://en.m.wikipedia.org/wiki/Is%E2%80%93ought_problem. Positive claims are about what is true. Normative claims are about what should be true, or rather what decisions we should make. Put another way, positive claims deal only with facts while normative claims deal also with values. GP is saying that it's the data-scientist's job to give the executive the facts and it's the executive's job to decide what to do about the facts.
- antipaul 4y agoYep. At this point, I essentially don't trust any ML result that shows > 95% accuracy. So often, those models proved to be over-fitted and not generalizable. But too many decision makers simply can't properly judge such results.
- derefr 4y ago> The role of an executive or decision maker is to apply a normative lens to problems. The role of the data scientist / economist / whatever is to reduce the uncertainty that an action will have the desired effect. Where do business analysts fit into this dichotomy? Their whole job is to poke around in Tableau in order to surface high-ROI strategies for the business to pursue. (Where, in choosing which proposals to surface to management, they're effectively making 90% of the strategic decisions.) Or how about corporate buyers in trading and retail companies? Or quantitative investment managers?
- SkyBelow 4y agoThis isn't just "Data Scientist" but scientist as well. The more a finding is in contradiction, either with existing scientific consensus or even with just popular culture, the more the science is criticized. I've seen unequal criticism based on how much people wanted the results to be true/false and even after responding to the criticism I've seen people just ignore science they don't like. The skepticism isn't a problem, the unequal application of it, the potential to harm careers, and the chilling effect as people wisen to how best meet their own personal goals is.
- disqard 4y agoAn interesting essay that echoes these same sentiments: https://ryxcommar.com/2022/11/27/goodbye-data-science/ https://ryxcommar.com/2022/11/27/goodbye-data-science/
- whoevercares 4y agoTrue - aka “are right a lot”
- _hcuq 4y agoSo Big Data isn’t dead. It’s just found it’s place in society….
- User23 4y ago> I used to joke that Data Scientists exist not to uncover insights or provide analysis, but merely to provide factoids that confirm senior management's prior beliefs. The SNAFU principle: communication is only possible between equals. When an hierarchical divide exists the subordinate will tell the superior what he wants to hear.
- nobody9999 4y ago>The SNAFU principle: communication is only possible between equals. When an hierarchical divide exists the subordinate will tell the superior what he wants to hear. Sadly true. As humorously depicted here[0]: In the beginning was the DEMO Project. And the Project was without form. And darkness was upon the staff members thereof. So they spake unto their Division Head, saying, "It is a crock of shit, and it stinks." And the Division Head spake unto his Department Head, saying, "It is a crock of excrement and none may abide the odor thereof." Now, the Department Head spake unto his Directorate Head, saying, "It is a container of excrement, and is very strong, such that none may abide before it." And it came to pass that the Directorate Head spake unto the Assistant Technical Director, saying, "It is a vessel of fertilizer and none may abide by its strength." And the assistant Technical Director spake thus unto the Technical Director, saying, "It containeth that which aids growth and it is very strong." And, Lo, the Technical Director spake then unto the Captain, saying, "The powerful new Project will help promote the growth of the laboratories." And the Captain looked down upon the Project, and He saw that it was Good! [0] https://www.anvari.org/fortune/Best_Fortunes/820_in-the-beginning-was-the-demo-project-and-the-project-was-without-form.html https://www.anvari.org/fortune/Best_Fortunes/820_in-the-begi...
- TEP_Kim_Il_Sung 4y agoGovernment should do it, that way we can be sure it is honest and correct.
- HybridCurve 4y agoAuthoritarian types consider any information derived by science which is contrary to their position as invalid or irrelevant because facts challenge their authority and ability to exercise control.
- fatneckbeard 4y agoyes. I used to think the Church had a honest disagreement with Galileo about heliocentricity. When I grew up I realized the Church never cared about orbits at all, what they care about is maintenance of status quo. And then when I got old, I realized, there is even a reason that some people want status quo... because they have usually been around long enough to see society fall apart into anarchy and mass murder, so in their mind, they are doing the right thing.
- andrewprock 4y agoThe church was not upset about heliocentrism. They were upset that Galileo was attempting to reinterpret the words of Bible in order to bolster his astronomical authority.
- andrewprock 4y ago"[Therefore,] when God willed that at Joshua’s command the whole system of the world should rest and should remain for many hours in the same state, it sufficed to make the sun stand still. In this manner, by the stopping of the sun, the day could be lengthened on earth—which agrees exquisitely with the literal sense of the sacred text.” - Galileo Galilei
- defrost 4y ago"The Church" wasn't then and isn't now a monolith of opinion. A modern characterisation of "The Galileo Affair" would be that he was SWAT'ed by someone he was really really mean online to. Thus the whole "Galileo affair" starts as a conflict initiated by a secular Aristotelian philosopher, who, unable to silence Galileo by philosophical arguments, uses religion to achieve his aim. [1] and While delle Colombe was almost alone in arguing publicly against Galileo, there was a group of scholars and churchmen who supported his Aristotelian views. After Galileo referred disparagingly to delle Colombe as 'pippione' ('pigeon'), his close friend the painter Lodovico Cigoli coined the nickname 'Lega del Pippione' ('The Pigeon League') for delle Colombe's group.[2] Galileo literally refered to delle Colombe (and friends) as Simplicio (simple minded) and worse in his highly popular Dialogue Concerning the Two Chief World Systems [3] and within a year or so the Pigeon League got their revenge, using their influence to have religuous charges bought against Galileo. The affair was complex since very early on Pope Urban VIII had been a patron to Galileo and had given him permission to publish on the Copernican theory .. this was very much a case of personal vendettas and internal politics rather than a straight up case of "The Church Versus Galileo". [1] https://en.wikipedia.org/wiki/Galileo_affair#cite_note-Speller2008-5 https://en.wikipedia.org/wiki/Galileo_affair#cite_note-Spell... [2] https://en.wikipedia.org/wiki/Lodovico_delle_Colombe https://en.wikipedia.org/wiki/Lodovico_delle_Colombe [3] https://en.wikipedia.org/wiki/Dialogue_Concerning_the_Two_Chief_World_Systems https://en.wikipedia.org/wiki/Dialogue_Concerning_the_Two_Ch...
- deterministic 4y agoBingo. Welcome to the world of office politics!
- icelancer 4y ago>>I did several experiments, and noticed that whenever I produced analysis that was in line with what management expected - my analysis was praised and widely disseminated. Nobody would even question data completeness, quality, whatever. They would pick some flashy metric like a percentage and run around with it. >> Whenever my analysis contradicted - there was so much scrutiny in numbers, data quality, etc, and even after answering all questions and concerns - analysis would be tossed away as non-actionable/useless/etc. It's a good sign at the company that I run, anytime our analysts/data scientists come up with metrics that say we're killing it, or that our ideas should bear a ton of fruit, the kneejerk reaction is to be extremely skeptical of the results. Usually they're still right. When the data scientists say we're fucking something up, we tend to pay a lot more attention. Only the paranoid survive, after all.
- dcl 4y ago110% my experience working in data science. I found it incredibly stressful to discover and provide analyses (even experimental results) that wasn't expected, or contradicted prior beliefs. The findings were always very harshly scrutinized, and typically lead to tons of pointless extra work to 'understand what is going on'.
- rahoulb 4y agoNot just data scientists. My friend runs a successful market research agency and she says she gets called in when management have decided they need to make a change but need evidence to sell it to the shareholders and staff.
- dredmorbius 4y ago"Data Scientists exist not to uncover insights ..." That was a plot point in Dirk Gentley's Holistic Detective Agency (1989), though the observation much pre-dates this.