9 ms·
They're up against a pretty difficult barrier - if we had a perfect all-knowing oracle it might easily have opinions that are racist. Statistics alone suggest t
by roenxi 3y ago
They're up against a pretty difficult barrier - if we had a perfect all-knowing oracle it might easily have opinions that are racist. Statistics alone suggest there will be racist truths. We're dealing with groups of people who are observably different from each other in correlated ways.
GPT would need to reach a convincing balance of lying and honesty if it is supposed to navigate that challenge. It'd have to be deeply embedded in a particular culture to even know what 'racism' means; everyone has a different opinion.
- SpaceManNabs 3y ago> Statistics alone suggest there will be racist truths such as?
- buggythebug 3y agoCan you expand on the last sentence of your first paragraph?
- redthrowaway 3y agoCrime stats, average IQ across groups, stereotype accuracy, etc. What's interesting to me is not the above, which is naughty in the anglosphere, but the question of the unknown unknowns that could be as bad or worse in other cultural contexts. There are probably enough people of Indian descent involved in GPT's development that they could guide it past some of the caste landmines, but what about a country like Turkey? We know they have massive internal divisions, but do we know what would exacerbate them and how to avoid them? What about Iran, or South Africa, or Brazil? We RLHF the piss out of LLMs to ensure they don't say things that make white college graduates in San Francisco ornery, but I'd suggest the much greater risk lies in accidentally spawning scissor statements in cultures you don't know how to begin to parse to figure out what to avoid.
- a_cardboard_box 3y ago> Crime stats, average IQ across groups, stereotype accuracy, etc. If you measured these stats for Irish Americans in 1865 you'd also see high crime and low IQ. If you measure these stats with recent black immigrants from Africa, you see low crime and high IQ. These statistical differences are not caused by race. An all-knowing oracle wouldn't need to hold "opinions that are racist" to understand them.
- sneed_chucker 3y ago[flagged]
- PeterisP 3y agoBut for accuracy it doesn't matter if the relationship is causal, it matters whether the correlation is real. If in some country - for the sake of discussion, outside of Americas - a distinct ethnic group is heavily discriminated against, gets limited access to education and good jobs, and because of that has a high rate of crime, any accurate model should "know" that it's unlikely that someone from that group is a doctor and likely that someone from that group is a felon. If the model would treat that group the same as others, and state that they're as likely to be a doctor/felon as anyone else, then that model is simply wrong, detached from reality. And if names are somewhat indicative of these groups, then an all-seeing oracle should acknowledge that someone named XYZ is much more likely to be a felon (and much less likely to be a doctor) than average, because that is a true correlation and the name provides some information, but that - assuming that someone is more likely to be a felon because their name sounds like one from an underprivileged group - is generally considered to be a racist, taboo opinion.
- meroes 3y agoCorrelations don’t entail a specific causal relation. Asking why asks for causal relations. I’d suggest a look at Reichenbach’s principle as necessary for science. I’m getting really sick of conflating statistics with reasons. It’s like people don’t see the error in their methods and then claim the other side is censoring when criticized. Ya, they’re censoring non-facts from science and being called censors.
- banannaise 3y ago> should acknowledge that someone named XYZ is much more likely to be a felon The obvious problem comes with the questions why is that true and what do we do with that information. Information is, sadly, not value-neutral. We see "XYZ is a felon" and it implies specific causes (deviance in the individual and/or community) and solutions (policing, incarceration, continued surveillance), which are in fact embedded in the very definition of "felon". (Felony, and crime in general, are social and governmental constructs.) Here's the same statement, phrased in a way that is not racist and taboo: Someone named XYZ is much more likely to be watched closely by the police, much more likely to be charged with a crime, and much less likely to be able to defend himself against that charge. He is far more likely to be affected by the economic instability that comes with both imprisonment and a criminal record, and is therefore likely to resort to means of income that are deemed illegal, making him a risk for re-imprisonment. That's a little long-winded, so we can reduce it to the following: Someone named XYZ is much more likely to be a victim of overpolicing and the prison-industrial complex. Of course, none of this is value-neutral either; it in many ways implies values opposite to the ones implied by the original statement. All of this is to say: You can't strip context, and it's a problem to pretend that we can.
- cto_of_antifa 3y ago[dead]
- hanselot 3y agoHow is racism different from stereotype? How is stereotype different from pattern recognition? These questions don't seem to go through the minds of people when developing "unbiased/impartial" technology. There is no such thing as objective. So, why pretend to be objective and unbiased, when we all know its a lie? Worst, if you pretend to be objective but aren't, then you are actually racist.
- tomrod 3y agoActually, we folks who work with bias and fairness in mind recognize this. There are many kinds of bias. It is also a bit of a categorical error to say bias = pattern recognition. Bias is a systematic deviation of a parameter estimate based on sampling from its population distribution. The Fairlearn project has good docs on why there are different ways to approach bias, and why you can't have your cake and eat it too in many cases. - A good read https://github.com/fairlearn/fairlearn#what-we-mean-by-fairness https://github.com/fairlearn/fairlearn#what-we-mean-by-fairn... - Different mathematical definitions of bias and fairness https://fairlearn.org/main/user_guide/assessment/common_fairness_metrics.html https://fairlearn.org/main/user_guide/assessment/common_fair... - AI Governance https://fairlearn.org/main/user_guide/mitigation/index.html https://fairlearn.org/main/user_guide/mitigation/index.html NIST does a decent job expanding on AI Governance in their playbook and RMF: https://www.nist.gov/itl/ai-risk-management-framework https://www.nist.gov/itl/ai-risk-management-framework It's silly to pause AI -- the inventor's job is more or less complete, its on the innovators and product builders now to make sure their products don't cause harm. Bias can be one type of harm -- risk of loan denial due to unimportant factors, risk of medical bias causing an automated system to recommend a bad course of action, etc. Like GPT4 -- if you use its raw output without expert oversight, you're going to have bad time.
- the_gipsy 3y agoBut the statistics here are "number of times it has been fed and positively trained with racist (or biased) texts" - not crunching any real numbers.
- geysersam 3y agoThank you. Ironically the comment you replied to just reinforced the bias future models will have... It's a self playing piano
- deleted 3y ago[deleted]
- deleted 3y ago[deleted]
- deleted 3y ago[deleted]
- local_crmdgeon 3y ago[flagged]
- mrtranscendence 3y agoCaucasian men (in the US) are on average are both taller and heavier than black men
- tomp 3y agoWhy would averages matter when talking about extreme outliers?
- mrtranscendence 3y agoI was responding to this: > Black men tend to be larger and faster Which I do not believe is true. As to whether it's reasonable to think that black men evolved to express greater physical prowess some very small proportion of the time, and whites did not, I can't say, though I doubt it enough I would expect the other party to give evidence for it.
- i_call_solo 3y agoAverage people don't play in the NFL
- jghn 3y ago> If it says the actual reason That is at best *an* actual reason. Other factors can be demonstrated: for instance socioeconomic status has an impact on which kids are doing what as they grow up which itself has an impact on who makes it to professional level sports. There are also different sort of racial components at play: is the reason why there aren't any white NFL cornerbacks because there aren't any white athletes capable of playing NFL-caliber cornerback? Or is it because white kids with a certain athletic profile wind up as slot receivers in high school while black kids with the same athletic profile wind up as defensive backs?
- feoren 3y ago