7 ms·
It's very strange that this would leak into a product limitation to me. I played with Gemini for maybe 10 minutes and I could tell there was clearly some very
by duxup 3y ago
It's very strange that this would leak into a product limitation to me.
I played with Gemini for maybe 10 minutes and I could tell there was clearly some very strange ideas about DEI forced into the tool. It seemed there was a clear "hard coded" ratio of various racial / background required as far as the output it showed me. Or maybe more accurately it had to include specific backgrounds based on how people looked, and maybe some or none of other backgrounds.
What was curious too was the high percentage of people whose look was specific to a specific background. Not any kind of "in-between", just people with one very specific background. Almost felt weirdly stereotypical.
"OH well" I thought. "Not a big deal."
Then I asked Gemini to stop doing that / tried specifying racial backgrounds... Gemini refused.
Tool was pretty much dead to me at that point. It's hard enough to iterate with AI let alone have a high % of it influenced by some prompts that push the results one way or another that I can't control.
How is it that this was somehow approved? Are the people imposing this thinking about the user in any way? How is it someone who is so out of touch with the end user in position to make these decisions?
Makes me not want to use Gemini for anything at this point.
Who knows what other hard coded prompts are there... are my results weighted to use information from a variety of authors with the appropriate backgrounds? I duno ...
If I ask a question about git will they avoid answers that mention the "master" branch?
Any of these seem plausible given the arbitrary nature of the image generation influence.
- prepend 3y agoIt does seem really strange that the tool refuses specific backgrounds. So if I am trying to make a city scene in Singapore and want all Asians in the background, the tool refuses? On what grounds? This seems pretty non-functional and while I applaud, I guess, the idea that somehow this is more fair it seems like the legitimate uses for needing specific demographic backgrounds in an image outweigh racists trying to make an uberimage or whatever 1billion:1. Fortunately, there are competing tools that aren’t poorly built.
- logifail 3y ago> This seems pretty non-functional and while I applaud, I guess, the idea that somehow this is more fair Fair to whom? > racists trying to make an uberimage It's a catastrophically flawed assumption that racism only happens in one direction. > if I am trying to make a city scene in Singapore <chuckle> I'm on a flight to Singapore right now, I'll report back :)
- FooBarBizBazz 3y ago> :) An entrepot of the British Empire with as much diversity as New York City if not more.
- logifail 3y ago> with as much diversity as New York City if not more I'm not sure Singapore is anywhere near as diverse as NYC: NYC (2020): 30.9% White (non-Hispanic) 28.7% Hispanic or Latino 20.2% Black or African American (non-Hispanic) 15.6% Asian 0.2% Native American (non-Hispanic) Singapore: 75.9% Chinese 15.1% Malay 7.4% Indian
- throwuwu 3y agoCan anyone explain in simple terms what the actual harm would be of allowing everyone to generate images with whatever racial composition they desired? If you can specify the skin colour one way you can do it the other ways as well and instead of everyone being upset at having this forced down our throats we’d probably all be liking pictures of interesting concepts like what if Native Americans were the first to land on the moon or what if America was colonized by African nations and all the founding fathers were black. No one opposes these concepts, people just hate having it arbitrarily forced on them.
- imetatroll 3y agoIt isn't "fair" when it is a misrepresentation of what the user asks for.
- gedy 3y ago> How is it that this was somehow approved? If the tweets can be believed, Gemini's product lead (Jack Krawzczyk) is very, shall we say, "passionate" about this type of social justice belief. So would not be a surprise if he's in charge of this.
- duxup 3y agoI was curious but apparently I’m not allowed to see any of his tweets. Little disappointing, I have no wish to interact with him, just wanted to read the tweets but I guess it’s walled off somehow.
- gedy 3y agohttps://pbs.twimg.com/media/GG6e0D6WoAEo0zP?format=jpg&name=900x900 https://pbs.twimg.com/media/GG6e0D6WoAEo0zP?format=jpg&name=...
- duxup 3y agoI wish I understood what people think they're doing with that "yelling at the audience type tweet". I don't understand what they think the reader is supposed to be taking away from such a post. I'm maybe too detailed oriented when it comes to public policy, but I honestly don't even know what those tweets are supposed to propose or mean exactly.
- Mountain_Skies 3y agoMoral outrage is highly addictive: https://www.psychologytoday.com/us/blog/domestic-intelligence/201803/the-dangerous-pleasures-outrage https://www.psychologytoday.com/us/blog/domestic-intelligenc... >Outrage is one of those emotions (such as anger) that feed and get fat on themselves. Yet it is different from anger, which is more personal, corrosive and painful. In the grip of outrage, we shiver with disapproval and revulsion—but at the same time outrage produces a narcissistic frisson. “How morally strong I am to embrace this heated disapproval.” The heat and heft add certainty to our judgment. “I feel so strongly about this, I must be right!” >Outrage assures us of our moral superiority: “My disapproval proves how distant I am from what I condemn.” Whether it is a mother who neglects her child or a dictator who murders opponents, or a celebrity who is revealed as a sexual predator, that person and that behavior have no similarity to anything I am or do. My outrage cleans me from association.” Seem to fit this particular case pretty well.
- sotasota 3y agoIf you ever wondered what it was like to live during the beginning of the Cultural Revolution, well, we are living in the Western version of that right now. You don't speak out during the revolution for fear of being ostracized, fired, and forced into a struggle session where your character and reputation is publicly destroyed to send a clear message to everyone else. Shut Up Or Else. https://en.wikipedia.org/wiki/Google's_Ideological_Echo_Chamber https://en.wikipedia.org/wiki/Google's_Ideological_Echo_Cham... Historians might mark 2017 as the official date Google was captured.
- numpad0 3y agoI'd put blame on App Store policy and its highly effective enforcement through iOS. Apple did not even aimed to be a neutral third party but was always an opinionated censor. The world shouldn't have given it power, and these types of powers needs to be removed ASAP.
- proxyon 3y agoThis is a very good point and prescient. Apple, Visa/MC/Amex/Discover, Google Play Store, and even internet backbones are extreme monopolies and now that corporate America has been seeded with social justice crusaders they are abusing their power. Most recently the people who own the pipes of the internet as a utility have been waging war on websites like kiwifarms and straight up banning it off of the clearnet for being "transphobic." This is dark stuff.
- duxup 3y agoI think we're a ways from the severity of the Cultural Revolution.
- sotasota 3y agoYes, but it didn't get there overnight. At what point was it too late to stop? We've already deep into the self-censorship and stuggle session stage. With many large corporations and institutions supporting it.
- cyanydeez 3y ago[flagged]
- influx 3y agoAsk James Damore what happens when you ask too many questions of the wrong ideology...
- magnoliakobus 3y agoI've truly never worked a job in my life where I would not be fired for sending a message to all my coworkers about how a particular group of employees are less likely to be as proficient at their work as I am due to some immutable biological trait(s) they possess, whether it be construction/pipefitting or software engineering. It's bad for business, productivity, and incredibly socially maladaptive behavior, let alone how clearly it calls into question his ability to fairly assess the performance of female employees working under him.
- xepriot 3y agoThis is dishonest. what is the point of this comment? Do you feel righteously woke when you write it? He was pushing back against a communist narrative that: every single demographic gruop should be equally represented in every part of tech; and that if this isn't the case, then it's evidence of racism/sexism/some other modern sin. Again what was the point of portraying the Damore story like that.
- magnoliakobus 3y ago[flagged]
- smsm42 3y agoNo, it's literally just a bunch of lies, which you probably picked up from some fourth-party retelling of the story. Damore sent it as a part of a specific conversation on specific topic, in place specially designated to hold such conversations. And his opponents distributed it with the purpose of silencing him because they disliked what he had to say. It wasn't a "manifesto", it was a document meant for internal discussion, on internal discussion forum, which has been seized and distributed in public by the opponents instead of trying to argue any opposing points. > I'm sorry you don't get it but most people wouldn't want to work with such a socially maladapted person who could compile all this research By "most people" you mean "myself and a couple of my friends who I didn't even ask but I am sure I know what they think because we all think the same". Actually, working with a person who bothers to support his opinions with well argued, well searched and well presented research, instead of running to the press crying "witches! there are witches here! burn them all!" is a very pleasant and productive thing. Even if you disagree with such person, at least you can have a civilized discussion, understand and appreciate their arguments and eventually hopefully find common solutions, and you have a reason to expect they'd behave in the same reasonable, professional and civilized manner. On the contrary, working with somebody who would each time you do something they don't like leak it to the hostile press who would sensationalize it and coordinate personal attacks on you would be a complete nightmare.
- logicchains 3y ago>How is it someone who is so out of touch with the end user in position to make these decisions? Maybe it's the same team behind Tensorflow? Google tends to like taking the "we know better than users" approach to the design of their software libraries, maybe that's finally leaked into their AI product design.
- wakawaka28 3y agoTheir social agenda leaks into their search and advertising products constantly. I first noticed a major bias like 8 years ago. It was probably biased even before that in ways I was oblivious to.
- TheKarateKid 3y agoIt has been known for a few years now that Google Image Search has been just as inaccurately biased with clear hard-coded intervention (unless it's using a similarly flawed AI model?) to the point where it is flat out censorship. For example, go search for "white American family" right now. Out of 25 images, only 3 properly match my search. The rest are either photos of diverse families, or families entirely with POC. Narrowing my search query to "white skinned American family" produces equally incorrect results. What is inherently disturbing about this is that there are so many non-racist reasons someone may need to search for something like that. Equally disturbing is that somehow, non-diverse results with POC are somehow deemed "okay" or "appropriate" enough to not be subject to the same censorship. So much for equality.
- Satisfy4400 3y agoJust tried the same search and here are my results for the first 25 images: 6 "all" white race families and 5 with at least one white person. Of the remaining 14 images, 13 feature a non-white family in front of a white background. The other image features a non-white family with children in bright white dresses. Can't say I'm feeling too worked up over those results.
- TheKarateKid 3y agoI was aware of the white background results, hence my other example query. Both yielded the same result. 7/25 = 0.28 = 28%. That's awful accuracy. Google would be out of business if their general search accuracy had a similar success rate. Interesting how "black american family" yields results where not a single person in the result is anything but Black. I suppose Google doesn't think that blended families are possible for this query. Where's that 28% precision rate this time?
- woobar 3y agoHow many images with black background or black clothes are there if you use word "black" in the same query?
- TheKarateKid 3y agoIn addition to my comment about Google Image Search, regular Web Search results are equally biased and censored. There was once a race-related topic trending on X/Twitter that I wanted to read more about to figure out why it was trending. It was a trend started and continuing to be discussed by Black Twitter, so it's not like some Neo-Nazis managed to start trending something terrible. Upon searching Google with the Hashtag and topic, the only results returned not only had no relevancy to the topic, but it returned results discussing racial bias and the importance of diversity. All I wanted to do was learn what people on Twitter were discussing, but I couldn't search anything being discussed. This is censorship.
- wakawaka28 3y agoThey do that about many topics. It's not consistently bad, but more often than not I have to search with multiple other search engines for hot topics. Google, Bing, and DuckDuckGo are all about equally bad. I haven't done much with Yahoo, but I think they get stuff from Google these days.
- randomdata 3y ago> Then I asked Gemini to stop doing that / tried specifying racial backgrounds... Gemini refused. When I played with it, I was getting some really strange results. Almost like it generated an image full of Caucasian people and then tried to adjust the contrast of some of the characters to give them darker skin. The while people looked quite photorealistic, but the black people looked like it was someone's first day with Photoshop. To which I told it "Don't worry about diversity" and it complied. The new images it produced looked much more natural.