4 ms·
It seems reasonable to expect that when you ask for a German soldier in the 1940s you won't a black man. Harmful? Meh. But clearly inyentionally distorting rea
by Jeff_Brown 3y ago
It seems reasonable to expect that when you ask for a German soldier in the 1940s you won't a black man.
Harmful? Meh. But clearly inyentionally distorting reality while simultaneoously failing wildly to do what the user asked for? Yes. And that's a bad precedent for a tool we hope will help us be smarter.
- jncfhnb 3y agoI don’t think so tbh. Much better to simply disclaim any knowledge of race and intentionally try to randomize it. This is not a tool to generate historically accurate photos. It simply cannot be.
- caekislove 3y agoA tool that is incapable of creating images that conform with objective reality and/or history seems like a pretty useless tool.
- jncfhnb 3y agoBad news for the wheel I guess
- silverquiet 3y agoI fail to see how proper hallucinations of Nazis are useful for becoming smarter (or any other purpose).
- Exoristos 3y agoOne of the Nazi officers Gemini produced appeared to be a young Jewish woman. _None_ was a white man. You might want to rethink what's useful for education.
- Jeff_Brown 3y agoIn itself probably not very important. But it illustrates that this thing was trained in a way that places ideology above reality. Whole countries have already shown us what that looks like, and it's bad.
- silverquiet 3y agoI'm not convinced that these LLMs have any concept of reality.
- init2null 3y agoPublicizing these stories helps break the illusion that truth is a critical part of the performance of any model, GPT-4 included. We are only guaranteed similitude with what is expected. Distortion and confabulation must be expected, but how can we train the public to properly interpret the responses?
- red-iron-pine 3y ago> Publicizing these stories helps break the illusion that truth is a critical part of the performance of any model, GPT-4 included if there is no truthiness to it, even in part, then what use is the tool? outside of brainstorming some creative media ideas, why would I ever use it for practical work purposes where I need a correct answer? plus once you shatter the illusion of trust, truth, and validity, all outputs may now be suspect. what else is getting nudged? subtle biases will certainly creep in, but if blatantly obvious or true data can't be delivered, why would I trust any other output?
- hackeraccount 3y agoThis is more like a modern day Daniel Webster trying to rationalize spelling by fixing auto correct. There'd be a million instances we'd laugh at - what is this "jail" business - some we'd think were reasonable but eventually we'd just go along with them all because why not? The idea of asking for an image a Confederate battalion and getting a Benetton ad is a joke to most people but there's some minority who won't get what's funny about it. The longer this keeps up the fewer people will get the joke. If you ever see pictures of how people in the middle ages drew things in the classical age you can get a feel for - they just drew pictures of everyone as if they were contemporaneous. The question in my mind is if abusing the truth like this is a greater harm then the benefit that comes from winning this political argument. It's like something out of 1984 I know but ... what if it is _really_ is a good thing? I feel like it's something out of fiction you know? Like The Ones Who Walk Away from Omelas - you can have a perfect society that just depend about telling this one set of lies. Or ... there was some other sci-fi story where it turned out that the previous generation had committed genocide and then covered it up by a sort of consensus of silence and shame. Realistically it's a fool's way around whatever problems we have. I can't any good comes out of telling yourself a lie. Plus it will and would never work. But still. You have to wonder...