14 ms·
These sorts of adjunct, off-to-the-side "ethics" teams are always corporate window dressing, and when push comes to shove they always get jettisoned when compet
by hn_throwaway_99 4y ago
These sorts of adjunct, off-to-the-side "ethics" teams are always corporate window dressing, and when push comes to shove they always get jettisoned when competition demands an increase in speed.
I don't mean to start a flame war, but this is a reason why I think "Chief Diversity Officers" are such an ill-conceived notion. It's not that I don't think diversity in corporate environments is extremely valuable, but it's that a Chief Diversity Officer doesn't really "own" any sub-organization of the business. That is, the Chief Product Officer owns the product teams, the Chief Technical Officer owns the engineering teams, the Chief Marketing Officer owns the marketing teams. Even the Chief Human Resources Officer, while largely providing support to other teams, still has sizable staff of their own to get their job down. A Chief Diversity Officer's job largely comes down to telling other teams how they should change or structure their teams. I have yet to see that approach work.
Different teams can certainly work to a common corporate goal, even if that goal isn't the primary focus of a particular team. If you really want to ensure that diversity is valued, any initiatives should actually be led by the teams who also do the main "work of the business", and the goals should be championed by the executives of these teams.
So, in the vein of this article, I think independent "ethical AI teams" are a really bad idea. Better to define what ethical AI means at a high leadership level, and if teams need particular experts in these areas they should just hire them as part of that team, not off as a part of some dysfunctional "ombudsman" role.
- swatcoder 4y agoI agree, but the flipside is that people with influence like nicely dressed windows. These roles might not satisfy their ostensible purpose, but they satisfy what may be an even more important purpose for the organization. It’s a cost of doing business (of a certain type).
- chitowneats 4y agoPlease state what you're implying here? I have a guess but I don't want to put words in your mouth.
- swatcoder 4y agoJust that investors, board members, executives, etc are individuals who are subject to fashion trends in organization design and feel strongly that their organizations should look a certain way at whatever time. For some, it’s earnest belief that the design is effective and for others it’s just signaling that they’re willing to play game and not upset apple carts unnecessarily. Regardless, these fashion trends are real and can’t be rejected lightly. As mentioned, they’re just part of operating at a certain scale.
- anonylizard 4y agoThis. People should understand AI safety != AI ethics. AI safety has two branches, AI ethics and AI alignment. Those two branches despise each other with intense passion. The alignment branch (responsible for developing RLHF->ChatGPT) believes AI ethics is completely trivial, and distracts attention away from existential risks. The ethics branch (responsible for all the media attention about racist AIs/bias etc) view alignment people as pie in the sky researchers whose results are irrelevant to society. It seems increasingly that the concerns from the ethics branch have not come to pass at all. Stable diffusion does not default to creating black people (you have to insert black into the prompt), this has not caused mass social harm despite the tens of millions of users. Hence companies are unwilling to pay for these teams. The other concerns, such as mass unemployment, or copyright of training material, are real, but they are better understood by economists, lawyers etc, rather than this awkward branch of AI ethics.
- echelon 4y ago[flagged]
- paramount 4y agoI do think the push for ethics in AI is important. As much as these functions do get sidelined in the prioritization process as outlined in the parent comment, the intent of introducing the rigor is valid.
- killjoywashere 4y agoMedical research cleared this hurdle a long time ago. Table 1 is always demographics of your population sample, allowing outsiders to assess your generalizability by age, gender, race, and a host of other factors that are often context-dependent.
- tbrownaw 4y agoThing is, what gets called "AI ethics" actually has approximately* nothing to do with AI. It's all about whichever field the particular use-case belongs to, and would lose nothing by seeing the AI as a black box. * IIRC there have been issues with models that find correlations being presented as finding causality. That is something that belongs to AI as a field; other people can't evaluate your stuff accurately if you've misinformed them about its capabilities.
- jcheng 4y agoWhat about Chief Compliance Officer or Chief Risk Officer? (Granted, not an awesome moment to be arguing that those are effective...) Or Chief Security Officer?
- bigtunacan 4y agoThese roles are often more effective as they are often given direct oversight, review and acceptance/rejection powers that allow them to behave as a gatekeeper; often times as a partner with legal departments.
- hn_throwaway_99 4y agoExcellent point actually, I think those examples made me adjust my opinion a bit. Chief Security Officer I don't really agree is analogous, because while all teams are responsible for security, there is enough "independent security work" (e.g. managing infrastructure and IT security) to warrant their own teams. But I think Chief Compliance Officer and Chief Risk Officer are pretty analogous - their main directive is to ensure other teams adjust their behaviors to follow the rules. I think the difference, though, is that these roles have unambiguous, and in many cases legally defined, requirements. I actually think it is the right moment to argue those are effective - SVB famously went without a Chief Risk Officer for a year despite having an unusually high number of risk committee meetings. We've all seen what happens when companies don't take risk and compliance seriously. With things that are "fuzzier" (and by "fuzzier" I mean real but ill-defined/hard to measure impacts on the business of making money) it's just too difficult to have impact on teams you don't own. A Chief Risk Officer can easily make the case "If you don't do what I say, our company will fail - like, completely cease to exist in 2 days." I don't think a Chief Diversity Officer has the luxury of that sense of immediacy. In any case, thanks for helping me think about this a little more broadly.
- lr4444lr 4y agoI think you should bite the bullet on this one: those officers he describes are excellent resources for the heads of other departments with the accountability to use as a resource, but they aren't unilaterally setting policy for the entire org., nor dictating specific rules to the rank and file. A Chief Diversity Officer could be useful in a similar capacity, e.g. a CFO decides that the company's charitable contributions should better reflect modern sensibilities, or when a head of HR wants to know how to recruit a more diverse pool, or when a CMO wants to brand-target better. But the Chief Diversity Officer isn't running his own parallel competing initiatives.
- bigtunacan 4y agoThis is certainly true in as much as I've experienced it in companies. The CDO (Chief Diversity Officer) has very little power and influence. Often it seems this is something many companies hire for so they can do the following 1. Say, "Look, we're trying here. We hired a CDO." 2. Have someone to take the blame if/when nothing changes. "We hired a CDO and nothing has changed, it must be their fault." I've seen some very frustrated people in this role that really want to make a difference, but find nothing but roadblocks. I think a CDO role would be more effective as an official part of HR and Recruiting groups as the first step is getting diverse applicants and hires.
- banannaise 4y agoIt's not terribly dissimilar from the Glass Cliff. You set your diverse hires up for failure, and then they fail, and then that failure gets pinned on them. It may not be malicious in nature, but it can definitely have negative effects on their career paths.
- alberth 4y agoCISO’s are another example.
- gorwell 4y agoIn practice these roles are about enforcing their own ideology, which informs their ethics and what they believe are the correct ethics for the entire world. That's how we get AI that is not neutral. Microsoft made a necessary move if their goal is to be more neutral.
- Redoubts 4y ago> a Chief Diversity Officer doesn't really "own" any sub-organization of the business. So what you're saying is we need commissars ;)
- dragonwriter 4y agoA Chief Diversity Officer owns a slice of the HR organization dedicated specifically to DEI issues, the same as a CTO in a (non-tech-industry) firm owns a specialized slice of the information organization.
- beepbooptheory 4y agoBut isn't the idea of a semiautonomous person/group overseeing ethical concerns precisely to overcome the very problem you're pointing to, namely, to not make their decisions based on a competitive edge? In an alternative top-down organization like you are saying, why would the rational company leaders ever pick the ethical side of a dilemma if the other lemma is making more money? Or hire anybody who would make that "wrong" decision? Like I can't understand this mindset where one says: "its clear the ethics team is getting in the way of us doing the business we could be doing, so its clear they are the problem." Isn't the friction the ethics team produces precisely their raison d'etre? Like at what point can we all stop pretending that we are angry at woo-woo philosophy experts telling us "no," and admit we really just have a conscious which is at odds with overwhelmingly financial goals of this world.
- ec109685 4y agoOff topic but it’s impressive your throwaway account has a karma of 49,005.
- hn_throwaway_99 4y agoI forgot to throw it away
- midoridensha 4y agoThrowaway accounts are usually used for some time before throwing them away. Obviously, this person operates on different timescales than most people.
- throwayyy479087 4y agoI use a throwaway because I'm afraid of cancel culture, not because I plan on throwing it away. I mean, I DO throw them away somewhat regularly, but still.
- 88913527 4y agoThe Chief Financial Officer doesn't tell me exactly how to spend money, hire, fire, etc. Yet, we have a CFO. The analogy doesn't land for me because CDO's are cross-cutting in manners analogous to other CXO functions. To me, this argument seems like window dressing to express a view that CDO's don't offer meaningful business value or justification. It should be fine to merely express a lack of perceived value in it, without that being perceived as inflammatory. One can value diversity without seeing CDO's as the mechanism for achieving diversity goals. There could be even more effective approaches out there.
- hn_throwaway_99 4y agoI think CFO is a pretty bad example. Every company I've worked at the CFO had a large team of accountants, etc., and they were specifically tasked with critical areas of the business (and by "critical" I mean things the business must absolutely do to function). I responded to another child comment where someone brought up Chief Risk Officers or Chief Compliance Officers, which I think are a better analogy. I adjusted my opinion based on their comment. It's not that I think "CDOs don't offer meaningful business value or justification." I just think that, for the most part, setting up the organizational structure like that is ineffective.
- deleted 4y ago[deleted]
- wskinner 4y agoEthical AI teams and CDOs both serve an important business purpose. It's just not the same as their nominal purpose. And like every other part of a business, once they outlive their usefulness, they are vulnerable to being cut.
- CatWChainsaw 4y agoIs it amusing or ominous that Chief Diversity Officers and Collateralized Debt Obligations share an acronym? :)
- karpierz 4y agoThe (productive) point of the ethical AI team is to have internal people to consult when launching an AI product. Embedding ethical AI people on teams makes about as much sense as embedding legal counsel. Their services won't be used on a single team nearly enough to justify their inclusion. Of course, it can be window dressing if the company doesn't actually have product teams care. Just like a CDO position. But you can't patch over a company culture problem with a re-org.
- daydream 4y agoThe product teams don’t care. And the ethical AI team doesn’t want to sit back and wait for people to come to them. They want a seat at the table for all important AI products. More in my comment on the other submission about this news https://news.ycombinator.com/item?id=35146611 https://news.ycombinator.com/item?id=35146611
- karpierz 4y ago> The product teams don’t care. As I said, you can't patch over culture problems with a re-org. If product people don't care, putting a person on the team that works against their interest will not make things better. Same thing with security/diversity/code quality/reliability. If the team doesn't care, putting an enforcer on the team will not fix the situation.
- g42gregory 4y agoThere is an implicit assumption that the teams are wrong. What about the wisdom of the crowds? If most teams think it's not needed, why do we think they are wrong?
- JohnFen 4y agoI don't see it as an implicit assumption that the teams are wrong, but a recognition that the teams have a fairly narrow goal that can easily blind them to larger implications of design decisions as they "move fast and break things". Having some sort of outside check on that seems wise to me.
- p1necone 4y agoHard agree. Anything important needs someone on each product team, either doing it as their full time job or just aware and caring about it if it's not enough to be a full time job. Same goes for DevOps, QA, UX design, product design, accessiblity etc. If there is no direct instantaneous collaboration while the thing is being built then all that's happening is you're slowing down your product teams while their only course of action is to provide lip service to the thing you want because nobody on the team is actually incentivized to care on top of all of the other shit they need to get done.
- qbasic_forever 4y agoBy your definition the entire board of directors is irrelevant since they don't own any part of the business verticals directly like the CEO, CTO, etc. Should they be removed too?
- hn_throwaway_99 4y agoThis is a non sequitur if ever I've seen one. The board of directors has the specific ability to fire the leadership of the company, that's where they get their influence and power.
- anonytrary 4y agoHaving a Chief Diversity Officer to fix a lack of diversity in my mind is no different than having a Chief Culture Officer to fix a poor company culture. Those sorts of problems can only be solved as the collective sum of every individual employee's actions. For example, if a large team of male engineers are all saying no to equally talented female candidates, then you've just hired shitty people. A diversity figurehead isn't going to change the fact that your team doesn't like or respect women.
- HervalFreire 4y agoNo this isn't true. Human psychology is much more complicated then shitty people and good people. Aspects of both being a complete ass hole and being a good person exists in the psychology of everyone. Little rules and arrangements from the top can serve to bring out the best in people. In the same way cities and cultures can be shaped by laws and rules so can people within corporations.
- anonytrary 4y agoThat's not how it goes down in practice, where a Chief Diversity Officer's job is to control diversity, rather than to let it flourish. The only "rules and arrangements" that trickle down from the top are the biases, actions, and behaviors of senior leadership. They are the ones who really set the examples. A company with a Chief Culture Officer sounds like one where the leaders are not interested in culture. That's why they hired someone else to "handle" it.
- onos 4y agoIn fact, studies find that the current variant of diversity training is making people beHave in more biased ways. So what you’re saying is true: if you want people for be less biased in their actions, avoid today’s en Vogue style of diversity training.
- r00fus 4y ago[cite needed]
- _8j50 4y ago"Ethics and inclusion ombudsman" is probably what they need, who reports to the board.
- HervalFreire 4y agoThis is a rosy way to put it. The real reason is this, corporations don't give a shit about ethics. Ethics exist to appease the public, employees and the law. If ethics get in the way of profits then fuck ethics. That's the way it works. What "AI" is at the leadership level is bullshit. It either makes money or it doesn't. The leaders are beholden to shareholders and shareholders in aggregate have the mob mentality of a psychopath with one goal: money. Right now AI isn't really enough of a threat in terms of ethics. Nobody cares too much yet so if such a group got in the way of profits, of course that group will be executed.
- JohnFen 4y agoThis. It's a pretty clear statement of what the company's ethical stance actually is.
- deleted 4y ago[deleted]
- maldev 4y agoYou're on the nose. I've been calling these types of positions a low interest rate phenomena.
- jillesvangurp 4y agoExactly, this is a form of ass coverage and not a genuine desire to do good. The job of ethics, legal, compliance, etc. departments is not necessarily to ensure the company behaves like a boy scout but to ensure that they have plausible deniability when they don't and to prevent companies from making expensive mistakes. The potential damage to the company is substantial and having such departments is a form of insurance against that. A necessary evil. The flip side is that such departments can put the brakes on because not doing risky things is the best way to ensure you don't take risk. If you ask a lawyer if you should do X, the answer is almost certainly going to be a "no" or a "yes" with a lot of "buts and ifs". That's their job and they bias to playing it safe. Same with financial compliance departments. Etc. That's fine if you are in a slow moving line of business where nothing changes much. But when you need to move more quickly, having a lot of internal bureaucracy and box ticking isn't helpful. With AI, it kind of stopped being academic in the past few years and this is now a multi billion dollar business opportunity that requires companies to act decisively and with purpose. Companies sitting on their hands because it's risky, scary, etc. are going to end up being sidelined. And of course there are some companies going all in on this. Most of these are startups that can afford to take risk. Meaning they are not going to fight with their hands behind their backs taking it carefully, easy, and slowly. Going all in means doing things that are risky, a little bit uncomfortable, and have uncertain outcomes. We see that playing out with the behavior of MS relative to Google. Google is not launching the AI stuff they have because it might do or say something embarrassing. MS has in fact launched a few AI things that said and did something mildly embarrassing (taybot, and recently the bing chat bot). Very entertaining. But it's fine. They learn from it and move on. Limited damage and it actually got them a lot of positive press. Making mistakes is an essential part of R&D. Having an ethics department trying to slow down things isn't that helpful.
- staunton 4y ago"Genuine desire to do good" doesn't make money and leads to less shareholder value. If "desire to do good" exists in a company, it is necessarily eliminated when the company either gets more efficient or fails. In order to even allow a company to "try to do good", the only possible measures are to change incentives and the environment in which it operates. Regulation and customer choice can change incentives. The environment (such as how people in the job market value money compared to working environment, "doing good", etc.) evolves naturally and is hard to change with purpose (my definition of environment in this context). I tend to view things like having such company roles a bit more positive. Yes, in most companies such a role cannot achieve almost anything and is created mainly for PR purposes. However, the people filling that role often really care about making a positive impact. The mere fact that having such a role does serve a PR purpose signals slowly moving in that direction. One just shouldn't expect all the people who didn't care before to have a sudden epiphany and become Mother Theresa. Change is possible and it often happens quickly, ever more quickly these days than in history. Imagine how abolition of slavery in the US south must have felt like. Moving towards "doing good" is hard, painful and prone to fail. I think incentivizing the creation of these PR roles is a lot better than doing nothing. Pretending to care and not caring is hypocritical but it actually still leads to better outcomes than everyone proudly not caring and constructing an ideology about why they shouldn't.
- piokoch 4y agoChief Diversity Officers is a cheap PR. You can be a company that forces its employees to piss into bottle as you punish going to toilet, but if you have Chief Diversity Officer, you change your logo once a year to rainbow colors then you are considered to be a progressive, well-behaved company. I don't even blame companies for this, they are just optimizing, if public is so stupid that it is buying it then, well, why not?
- ETH_start 4y agoIt's not so much about keeping the public on its side as dispelling the notion that it has created a hostile work environment for any particular protected class, in the event that a lawsuit is brought against it by the anti-discrimination industry: https://richardhanania.substack.com/p/wokeness-as-saddam-statues-the-case https://richardhanania.substack.com/p/wokeness-as-saddam-sta... >>Even after the case has been litigated, we still do not know what exactly Tesla could have done to avoid the $137 million judgment (it may be reduced on appeal). Employees did in fact get in trouble for using the n-word and drawing racist cartoons. In retrospect, they probably would’ve been safer if they just fired everyone who Diaz or Di-az accused of racism, at least the non-blacks, but there’s no guarantee that would’ve worked either, as they were in an industry that required them to rely on workers who hadn’t yet internalized elite ways of thinking about race. If they had fired black people for using the n-word too, would that have helped or hurt them in trying to avoid a lawsuit? It’s difficult to say, and that’s sort of the point. >>For next time, there’s little Tesla can do but go all in on diversity training, be as enthusiastic as possible in adopting whatever next race fad comes out of academia, and hope that the next jury isn’t as woke as the one they got this time. Until anti-discrimination laws are rolled back, or come to be based on clear and objective standards, there is no other way.
- SturgeonsLaw 4y agoThe names I'd let people call me for $137M...
- prepend 4y agoChief Diversity Officer also help increase the ratio of underrepresented populations in company officers without having to change any existing officers. If the goal is to increase minority positions, then you can do this by hiring new officers to replace attrition. This takes a long time and constraining available candidates for key positions is probably frowned upon. Or you can add a new position, increasing the denominator and numerator but likely hitting your diversity ratio target (ie going from 1:8 existing officers to 2:9 helps in dashboards and whatnot). And of course, I think these positions do have the potential to improve topics across the organization. I think it’s the easiest step to make and makes a non-zero positive effect, so are so common.
- hnbad 4y agoThe elephant in the room is that "ethics" and "diversity" and so on are not business concerns in the sense that they help make the company money. The Chief Diversity Officer is a thing if there is a market pressure for companies to have one but the goal if the company is to maximize its profit and once having an ethics team or a diversity team gets in the way of that, they'll be overturned or abandoned. It's literally virtue signalling (i.e. a performative display of virtue rather than a legitimate interest in the virtuous behavior itself). What should be concerning is that the environment has changed in such a way companies find it more profitable to forego these signals or maybe even use that change itself as a signal (e.g. consider Coinbase making a big show of becoming "apolitical" and gaining recognition from a certain audience for that).
- joshxyz 4y agodiversity equity and inclusion, oh dear.
- pc86 4y agoAlmost entirely, the existence of Chief Diversity Officers - and to a lesser but still prevalent extent, this "off-to-the-side" teams you mention - are just jobs programs with an identity politics twist. CDOs exist so that the "right" people can have a high-power (even if only via public perception), well-paid C-suite role. These ethics teams exist so that a group of the "right" people can level up their resumes. Instead of being a developer at a bank in Omaha you can be on the AI ethics team at a startup. Instead of being a developer at a startup you can be on the AI ethics team at a FAANG.
- jrochkind1 4y agoMore than being created to create jobs, I suspect things like ethics teams are mainly created for PR purposes, to make the company look good -- and in fact, the "product" they are expected to produce are defenses against the company looking bad, keep the actual product teams from doing things that make the company look bad. (Whether they are given the tools to succeed at this is another question, but it's not like people not given the tools to succeed at large organizations is unusual!) If an AI product makes Microsoft look really bad publicly due to something understood by the public as an ethical concern, the ethics team will be back.
- angstrom 4y agoIf it wasn’t for appearances only it would be under HR or perhaps HR would report into DEI role.
- kcplate 4y ago> More than being created to create jobs, I suspect things like ethics teams are mainly created for PR purposes, to make the company look good -- and in fact, the "product" they are expected to produce are defenses against the company looking bad Definitely are positions invented by lawyers to provide a safe harbor to minimize corporate legal and PR liabilities while those PR liabilities are burning bright among the public. Practically to the minute that the public focus on DEI is distracted to whatever the “next thing” is you will see these positions start disappearing or absorbed into HR and some new position created to satisfy the optics and create a new safe harbor for the next thing.
- mordae 4y agoHahaha, reminds me of Strategic Planning and Innovation departments I've seen at various public sector orgs.
- xaero_the_bot 4y agoEveryone is agreeing with this comment. That's awesome, I do too! But, OP felt they had to post with throwaway account. And so do I. This also speaks volumes.
- nonethewiser 4y agoWhy not create a diversity team? If diversity is a good goal and companies aren’t meeting it then why not create a diversity team to make more progress?
- bonadrag 4y ago> It's not that I don't think diversity in corporate environments is extremely valuable The fact that you pre-emptively accept the idea that maximizing diversity to its limits is beneficial to corporations shows that people just take these things at heart because "the people in charge said so". It is not a coincidence that much of the research of the supposed benefits of diversity in businesses comes from business schools in prestigious institutions—HBR, Stanford Business School, etc. As these institutions are one of the most authoritative entities of the structures of power in the West. At some point this bubble must burst.
- enumjorge 4y ago> maximizing diversity to its limits is beneficial to corporations That’s a straw man argument. Diversity efforts are not about maximizing “to its limits”. And most research about business come from the same prestigious business schools. Unless you think all research coming them are suspect, I don’t really understand your point.
- hn_throwaway_99 4y ago> The fact that you pre-emptively accept the idea that maximizing diversity to its limits is beneficial to corporations I literally never said that, nor do I believe it, nor do I quite understand what "maximizing diversity to its limits" means. My belief primarily comes from working in a range of companies and environments, some that were quite diverse, and some that were really lacking in diversity (and by "lacking in diversity" I mean cases where, in just one example, we had a sizable team with only a single woman), and I've seen that the environments that were lacking in diversity had very specific problems that were a detriment to the business (in addition to just generally sucking for some folks specifically due to that lack of diversity).
- m3kw9 4y agoAka Chief Woke
- cataphract 4y agoRaymond Chen calls this "you're not my manager": https://devblogs.microsoft.com/oldnewthing/20070522-00/ https://devblogs.microsoft.com/oldnewthing/20070522-00/
- reocha 4y agoThe need for maximization of profits will pretty much always trump any sort of ethics team in place. LLM have been selected as the "new frontier" for a lot of these companies an in turn any sort of "fat" that can be trimmed from the system will be.
- jjav 4y ago> A Chief Diversity Officer's job largely comes down to telling other teams how they should change [..]. I have yet to see that approach work. Similar challenge faced by CISOs everywhere. Yes, the CISO usually gets to own some little piece (depends on the company) but most of the job is about trying to sweet talk the other parts of the company to care about security without having actual ownership authority to make it happen.
- deleted 4y ago[deleted]
- leshow 4y agoPerhaps, but the alternative to a CDO is just no CDO, right? Even if the CDO has marginal effectiveness, it seems better than not having one at all. Similarly, an ethics team over no ethics team seems preferable. A single individual on a team would easily be outnumber or ostracized, I'm not sure how that situation would produce better outcomes. I'd love to know what 'ethical AI' looks like when we exist in a system where the AI is going to replace human workers to the benefit of the employer class. I have nothing against the technology, but it's a productivity tool that will only benefit a certain set of people.
- dnissley 4y agoWe can argue about whether window dressing is better than no window dressing, or we can use our attention on arguments that actually matter. It's like arguing about the amount of power drawn by electronics chargers in the context of global warming -- paying any attention to such details can suck the air out of the room we need to solve much more pressing issues where we can get much more traction.
- happymellon 4y agoCompletely agree. It's the same as having "security" outside of the team, it becomes an us Vs them mentality. How can we work around this new unannounced security/diversity requirement to get our product out of the door in the timescales that have been demanded of us?