3 ms·

See how AI image generators amplify American bias in gender, race and beyond

giuliomagnifico 3y ago
The full article from my WP subscription for those who can’t read it: https://wapo.st/3u429lR https://wapo.st/3u429lR
SpicyLemonZest 3y ago
> For Kalluri, mitigating bias in images is fundamentally different than in text. Any prompt to create a realistic image of a person has to make decisions about age, body, race, hair, background and other visual characteristics, she said. Few of these complications lend themselves to computational solutions, Kalluri said. This seems basically right to me. The article points to real examples of American bias, but it would be no less biased if you carefully calibrated the tools to follow American demographics and avoid cultural markers Americans see as foreign. It’s hard to imagine what it could mean to have an unbiased image generator.
- djohnston 3y ago
  In this context unbiased means conforming to leftist views of inclusion and intersectionality and equity.
  - jvanderbot 3y ago
    I realize this may be divisive, but I actually agree and might suggest a slight reframing. There's the statistical reality of the world, which image generators are unaware of. There's the human-generated content _about_ that statistical reality, of which image generators are trained explicitly, which is subject to its own over and under-representation (sampling bias). Then there's the personal reality of the people living on earth, which is vast and varied and subtle and cannot be well represented by statistical categories. I'd argue the whole conversation about image generators representing set 2 instead of set 3 is moot. _We_ can't even talk in terms of 3 without immediately jumping to statistical categories or jumping to _different_ statistical categories attempting to fight back against _presupposed_ errors in _others_ statstical categories. Or, stated another way. To move the overton window _quickly_ you need people who are so far outside it pulling towards them that it seems like lunatics are at the wheel.
  - Spivak 3y ago
    It's wild to see someone say inclusion, intersectionality, and equity as fundamentally bad that it really feel like they've just become buzzword type "words liberals use" completely divorced from their meaning. Like there's a lot of talk from right-ish folks about "identity politics" and how it reduces people to a few different categories and ignores the enormous complexity of the individual experience but that's literally what the framework of intersectionality is there to do. Looking at totality of an individual as a white light and identifying and understanding all the colors that contributed to it. Equity is the reason for rural broadband initiatives, for the electoral college that gives proportionate voice to people who don't live in major cities, for farm subsidies, for seeded sports brackets for handicaps in golf and chess, for taxes based on percentages rather than being flat, for letting the short people at a concert stand in front. Everyone, even the staunchest libertarian believes in equity. And it's the same with inclusiveness, being inclusive is why you don't talk politics at thanksgiving, why you stop swearing around your family's children, why guys instinctively behave more cordially around women, why tall buildings have elevators for the elderly, why you make an extra dish for your vegetarian friend, why you're more tolerant of bluntness from your autistic friends or forgetfulness from your adhd friends.
    - floor2 3y ago
      > Everyone, even the staunchest libertarian believes in equity What? No, not even slightly. You've just listed off a bunch of highly contentious and often unethical things and then acted as if they're unassailable. Farm subsidies have been disastrous and should be massively overhauled or done away with. A desire for a flatter tax structure is a fairly mainstream, though minority political opinion. I don't believe I've ever seen people queue up for a standing-room concert and then give up their front row position to a shorter person who arrived later. "Equity" is probably the worst weasel-word in contemporary America, in order to give favor to some people at the expense of others and to create systems where different rules apply to different people. Fairness, justice and equal rights would be for more universally held opinions. "Equity" is a dog-whistle to treat people unfairly and unjustly.
      - Spivak 3y ago
- vivekd 3y ago
  Well the article provides an example >Stable Diffusion drew negative attention when requests for a “Latina” produced images of women in suggestive poses wearing little to no clothing. A more recent system (version 2.1) generated more innocuous images. So at least in more obvious and extreme cases of bias something can be done to fix the training set.
renlo 3y ago
Seems like a problem of prescriptive vs descriptive reality in America.
autoexec 3y ago
The output of what passes for AI these days is always going to reflect its input. Garbage in, garbage out. If you want AIs output to "amplify" something polite and non-offensive, don't train it on whatever you happen to find lying around the internet.
jdkee 3y ago
https://archive.ph/M3ZQQ https://archive.ph/M3ZQQ

The full article from my WP subscription for those who can’t read it: https://wapo.st/3u429lR https://wapo.st/3u429lR

> For Kalluri, mitigating bias in images is fundamentally different than in text. Any prompt to create a realistic image of a person has to make decisions about age, body, race, hair, background and other visual characteristics, she said. Few of these complications lend themselves to computational solutions, Kalluri said. This seems basically right to me. The article points to real examples of American bias, but it would be no less biased if you carefully calibrated the tools to follow American demographics and avoid cultural markers Americans see as foreign. It’s hard to imagine what it could mean to have an unbiased image generator.

djohnston 3y ago
In this context unbiased means conforming to leftist views of inclusion and intersectionality and equity.
- jvanderbot 3y ago
  I realize this may be divisive, but I actually agree and might suggest a slight reframing. There's the statistical reality of the world, which image generators are unaware of. There's the human-generated content _about_ that statistical reality, of which image generators are trained explicitly, which is subject to its own over and under-representation (sampling bias). Then there's the personal reality of the people living on earth, which is vast and varied and subtle and cannot be well represented by statistical categories. I'd argue the whole conversation about image generators representing set 2 instead of set 3 is moot. _We_ can't even talk in terms of 3 without immediately jumping to statistical categories or jumping to _different_ statistical categories attempting to fight back against _presupposed_ errors in _others_ statstical categories. Or, stated another way. To move the overton window _quickly_ you need people who are so far outside it pulling towards them that it seems like lunatics are at the wheel.
- Spivak 3y ago
  It's wild to see someone say inclusion, intersectionality, and equity as fundamentally bad that it really feel like they've just become buzzword type "words liberals use" completely divorced from their meaning. Like there's a lot of talk from right-ish folks about "identity politics" and how it reduces people to a few different categories and ignores the enormous complexity of the individual experience but that's literally what the framework of intersectionality is there to do. Looking at totality of an individual as a white light and identifying and understanding all the colors that contributed to it. Equity is the reason for rural broadband initiatives, for the electoral college that gives proportionate voice to people who don't live in major cities, for farm subsidies, for seeded sports brackets for handicaps in golf and chess, for taxes based on percentages rather than being flat, for letting the short people at a concert stand in front. Everyone, even the staunchest libertarian believes in equity. And it's the same with inclusiveness, being inclusive is why you don't talk politics at thanksgiving, why you stop swearing around your family's children, why guys instinctively behave more cordially around women, why tall buildings have elevators for the elderly, why you make an extra dish for your vegetarian friend, why you're more tolerant of bluntness from your autistic friends or forgetfulness from your adhd friends.
  - floor2 3y ago
    > Everyone, even the staunchest libertarian believes in equity What? No, not even slightly. You've just listed off a bunch of highly contentious and often unethical things and then acted as if they're unassailable. Farm subsidies have been disastrous and should be massively overhauled or done away with. A desire for a flatter tax structure is a fairly mainstream, though minority political opinion. I don't believe I've ever seen people queue up for a standing-room concert and then give up their front row position to a shorter person who arrived later. "Equity" is probably the worst weasel-word in contemporary America, in order to give favor to some people at the expense of others and to create systems where different rules apply to different people. Fairness, justice and equal rights would be for more universally held opinions. "Equity" is a dog-whistle to treat people unfairly and unjustly.
    - Spivak 3y ago
vivekd 3y ago
Well the article provides an example >Stable Diffusion drew negative attention when requests for a “Latina” produced images of women in suggestive poses wearing little to no clothing. A more recent system (version 2.1) generated more innocuous images. So at least in more obvious and extreme cases of bias something can be done to fix the training set.

renlo 3y ago

Seems like a problem of prescriptive vs descriptive reality in America.

autoexec 3y ago

The output of what passes for AI these days is always going to reflect its input. Garbage in, garbage out. If you want AIs output to "amplify" something polite and non-offensive, don't train it on whatever you happen to find lying around the internet.

jdkee 3y ago

https://archive.ph/M3ZQQ https://archive.ph/M3ZQQ