6 ms·
Google to fix AI picture bot after 'woke' criticism
- adrr 3y agoI did find it humorous it gave me a woman Santa Claus when i asked for images Santa. The founding fathers prompt gave me a picture of all the founding fathers.
- typeofhuman 3y agoGemini AI refuses to generate images of "white male scientists" has no problem with other ethnicities. https://twitter.com/alexthechick/status/1760331428133253312 https://twitter.com/alexthechick/status/1760331428133253312
- edgyquant 3y agoIt’s pretty clear it has an enforced diversity system where the quota is >50% for non-white people and usually >75%. There are some hilarious examples like asking it to generate German soldiers in 1941 results in black guys or Asian woman in nazi uniforms.
- mortallywounded 3y agoReminds me of the Marvel movies when they flash back to the 1940s.
- sergiomattei 3y agoThis just seems like a bug.
- frizlab 3y agoOn the contrary, this was very much deliberate. https://twitter.com/BasedTorba/status/1760486551627182337 https://twitter.com/BasedTorba/status/1760486551627182337
- ryandvm 3y agoGemini wouldn't even create a picture of Mark Twain for me. This obsessive need to self-censor everything is how Google will fumble the ball on useful AI.
- ethbr1 3y agoIs it victory or failure when we pave over the troublesome parts of history so completely that future generations wonder what we were all worked up about?
- Spivak 3y agoThis one is more ignorance than malice. They're trying to make the AI not assume conventionally attractive white people for almost all image requests involving people and historical images are getting caught in the crossfire.
- remarkEon 3y agoNo one knows that for certain, but I personally find it very hard to believe that all these super smart people released a model this bad and this wrong on accident. Google employees that worked on this may genuinely believe that this is the right way to build an AI model, where it intentionally obfuscates history and lies to you. That's actually a perspective that one can have on how to build these tools, I think. Maybe we don't want the AI to reflect reality because reality doesn't live up to certain expectations. But at the end of the day that's a reflection of the creators' own biases.
- Spivak 3y ago> that all these super smart people released a model this bad The model isn't bad, that's not how this race compensation works, at least all the implementations I've seen. They do it by rewriting the prompt behind the scenes. DALL-E 3 currently does it this way; they even tell you the final prompt in the response. Google isn't the first company that makes an image generator to make this exact mistake by lazily inserting races into people's prompts.
- remarkEon 3y agoI don't follow. You say the model isn't bad, and then proceed to list ways in which it is, in fact, bad. Which is it?
- duringmath 3y agoI don't get why some people are so up in arms about this, it's kind of funny I guess but it's not like it matters in the scheme of things.
- xwowsersx 3y agoAnd yet, if the roles were reversed, with black and brown historical figures portrayed as white, there would likely be widespread outcry over the "erasure" of those individuals.
- duringmath 3y agoYeah I think that's what they tried to avoid but they went too far in the other direction
- zmgsabst 3y agoThis isn’t the “other direction”, it’s the same direction with different victims.
- typeofhuman 3y agoWhich is odd because white people are the minority.
- kaliqt 3y agoIt matters a lot. It's quite literally erasure of factual history, science, geography, everything. Inserting bias into datasets to "counter bias" is bias in and of itself.
- earthwalker99 3y ago>It's quite literally erasure of factual history, science, geography, everything. As American as apple pie
- ethbr1 3y ago
- deleted 3y ago[deleted]
- earthwalker99 3y ago>Google is racing to fix its new AI-powered tool for creating pictures, after claims it was over-correcting against the risk of being racist. "We don't think you fight fire with fire best, we think you fight fire with water best. We're gonna fight racism not with racism, but we're gonna fight it with solidarity. We're gonna fight capitalism not with black capitalism, we're gonna fight it with socialism." —Fred Hampton, Black Panther (shot dead in his sleep by the Chicago Police Department, RIP) https://youtu.be/S3mungAFfoc?si=begCTISEw_dus7_u https://youtu.be/S3mungAFfoc?si=begCTISEw_dus7_u
- mortallywounded 3y agoHold on-- Abraham Lincoln wasn't a black trans non-binary demi-human?
- deleted 3y ago[deleted]
- CSMastermind 3y agoThis highlights the need for open-source models and transparency in proprietary guardrails. The results here are so transparently bad that it's impossible to ignore, but there could be other, much more subtle manipulations. It seems an odd oversight that one of Google's core AI principals isn't "Produce accurate information" https://ai.google/responsibility/principles/ https://ai.google/responsibility/principles/
- ethbr1 3y ago> but there could be other, much more subtle manipulations. I always thought that the biggest danger of foreign-controlled social media wasn't data mining... but rather +/- 5% virality of posts with a certain view. LLMs without back-end transparency seem even worse.
- thepasswordis 3y agoIt's not just the picture bot, though. If you ask it for strategies to avoid homeless encampments, for instance, it will give you a lecture about inclusivity, and suggest that you shouldn't try to avoid this at all. I asked it which neighborhoods I should avoid in Kansas City, and it refuses to answer this question because of discrimination. I asked which schools have the best test scores record (so I can send my children there), and I get a lecture about how test scores aren't a good metric and following them could lead to discrimination. This is just...pathetic. These are all things that normal, rational human beings would want to know. Where are the safest neighborhoods with the best schools? There is absolutely nothing wrong with this type of question, and absolutely nothing wrong with wanting to discriminate against poor schools and dangerous neighborhoods. Quite frankly I don't understand what the point of gemini is when it refuses to give answers on basic things. Google search results are full of blogspam and listicle spam, and now gemini, which could be a way of avoiding this, is absolutely kneecapped by whatever ridiculous notions they've given it about the way people are supposed to think and act.
- dorkwood 3y agoI asked for an image of an attractive man and received a lecture on how "focusing solely on physical appearance can be limiting and reductive". Instead, it said, it would offer me images of "men from diverse backgrounds and ethnicities", so that I could "appreciate the beauty and variety that exists in the world, and avoid perpetuating narrow and unrealistic beauty standards". It then generated an image of an old and somewhat sad-looking Indian man with a receding hairline.
- wannacboatmovie 3y agoThe same kindred spirits who were complicit in creating this garbage have now flagged this off the front page. Sad.
- ethbr1 3y agoHardening your heart just leaves you with a heavy heart. Better to have compassion for even those we disagree with.
- Tommah 3y ago> For example, a prompt seeking images of America's founding fathers turned up women and people of colour. I smell a sequel to Hamilton.
- pixxel 3y agoFlagged. Now that San Francisco is asleep let’s see if we can bring it back from the dead. This replacement has been evident with google image search for years. Nothing was done about it. Perhaps their bot used their own data, heh.
- edgyquant 3y agoYeah it’s bull shit that we can’t unflag it and it’s left flagged by the staff.