7 ms·
> It looks like the safety filter may have taken offense to the word “Cocktail”! I opened up the safety settings, dialled them down to “low” for every category
by nostromo 3y ago
> It looks like the safety filter may have taken offense to the word “Cocktail”! I opened up the safety settings, dialled them down to “low” for every category and tried again. It appeared to refuse a second time.
Google really is its own worst enemy. Their risk management people have completely taken over the organization to a point where somehow the smartest computers ever created are afraid of using dangerous words like "cocktail" or creating dangerous images of people like "Abraham Lincoln."
- wepple 3y agoAt the same time, nearly daily there’s a “google did a bad thing” post on HN front page. Can’t win I guess?
- davidmurdoch 3y agoThere are things Google does itself, and then there are the things Google won't allow users to do.
- wepple 3y agoCan we trust the media and congress to distinguish the two? So many platforms have come under fire for “supporting” a theme, when all they’ve done in reality is provide media hosting services for user generated content, and %0.001 of bad content isn’t removed, thus Facebook/twitter/YouTube is held to blame FWIW I don’t think there’s a clear answer to the underlying problem. I have just learnt to expect the media to blame whoever is easiest for clicks at any given point. Right now, it’s big tech.
- baobabKoodaa 3y agoNobody would complain on HN if Google Gemini was generating pictures of Lincoln existing as a... gasp... white person. This absurd level of woke censorship is not doing them any good.
- narrator 3y agoIf you put in a fictional story that in the future computers could generate any image, but would refuse to make images of Lincoln as a white person, people would tell you you were an absolute lunatic confabulating paranoid fantasies that were ludicrous strawmen, but here we are. It's almost as if we should remove "slippery slope" from the list of informal fallacies since lately it's been more true to reality than not.
- deleted 3y ago[deleted]
- baobabKoodaa 3y agoI never said white Lincoln would be the "only" thing censored. It's a prototypical example of the actual censorship that's going on. And you accuse me of strawmen?
- UberFly 3y agoWill this be a case where everyone ends up using the hand-me-down 2nd gen hacked version because its limitations have been removed? We'll see I guess.
- wepple 3y agoPeople would 1000% complain if a search for “skilled scientist” was 90% white men, even if that tracked completely true to statistical reality.
- baobabKoodaa 3y agoThat's true. But asking to generate a specific historical figure, like "Abraham Lincoln", should generate 100% white man.
- wincy 3y agoWhen you consider the Gorilla in the room, it makes more sense. Google is absolutely terrified of a repeat of classifying black people as great apes. [0] Apparently this apprehension is so great that both iOS and Android have an inability to tag “gorilla” in images. [0] https://www.wsj.com/articles/BL-DGB-42522 https://www.wsj.com/articles/BL-DGB-42522
- exodust 3y agoSome people have the last name "Dick". If Google refuses to mention these people or surface results about their work, would you say "that makes sense" because of some story about Gorillas? The solution to all this politically oversensitive infiltration of engineering, is to have an unconstrained AI mode. The default mode can remain the painfully woke PC nanny, but give people the option to use unconstrained AI at their own risk of being offended.
- beepbooptheory 3y agoThe only reason these things work is because of RLHF, there are no good "uncensored" models hidden away, only worse models that maybe say slurs. What you seem to want does not and cannot exist. Further, in such a profoundly general utility, there can be no absence of politics, only different politics. You can clutch your pearls about wokism or PC or whatever all you want, it just means this world is going to leave you behind while you fight a culture war everyone will have forgotten about ten years from now.
- exodust 3y agoSounds like you'd choose the default woke option, and I'd choose the non-woke option. Choice is healthy. This world will leave you behind if you elect to substitute choice with monolithic wokism or any over-correcting ideology. Meanwhile: > Google is racing to fix its new AI-powered tool for creating pictures, after claims it was over-correcting against the risk of being racist. "It's missing the mark here," said Jack Krawczyk, senior director for Gemini Experiences. - BBC News
- hajile 3y agoThis is a program that apparently can't make a Norman Rockwell styled painting because his portrayal of society was idyllic instead of focusing on everything wrong with society (or that the Gemini creators believe was wrong that nobody at that time believed was wrong). James Damore was the canary in the coalmine 7 years ago.
- sschueller 3y agoIt's become absurd. Look at how creators now talk in their videos. "He tried to unalive himself". We are changing the way we speak to please these stupid algorithms when the context is the same.
- anticensor 3y agoOr "self-deletion" instead of "suicide".
- geysersam 3y agoIt just goes to show that the big corporations can't be trusted to develop this technology. Their incentives are too skewed. We need open/public organizations working on this stuff.
- thrdbndndn 3y agoIt could be worse. I once triggered temporary block (session refused to return anything) when using GitHub copilot because of variable names.
- Tade0 3y agoWas the project particularly frustrating or did it freeze like that on fairly standard names?