6 ms·
I truly wonder what "unsafe" scenarios an image generator could be used for? Don't we already have software that can do pretty much anything if a professional h
by s1k3s 3y ago
I truly wonder what "unsafe" scenarios an image generator could be used for? Don't we already have software that can do pretty much anything if a professional human is using it?
- t_von_doom 3y agoI would say the barrier to entry is stopping a lot of ‘candid’ unsafe behaviour. I think you allude to it yourself in implying currently it requires a professional to achieve the same results. But giving that ability to _everyone_ will lead to a huge increase in undesirable and targeted/local behaviour. Presumably it enables any creep to generate what they want by virtue of being able to imagine it and type it, rather than learn a niche skill set or employ someone to do it (who is then also complicit in the act)
- hypocrticalCons 3y ago"undesirable local behavior" Why don't you just say you believe thought crime should be punishable?
- KittenInABox 3y ago[Edited: I'm realizing the person I'm responding to is kinda unhinged, so I'm retracting out of the convo.]
- hypocrticalCons 3y ago[flagged]
- wongarsu 3y agoI imagine they might talk about things like students making nudes of their classmates and distributing them. Or maybe not. It's hard to tell when nobody seems to want to spell out what behaviors we want to prevent.
- hypocrticalCons 3y agoStudents already share nudes every day. Where are the Americans asking about Snapchat? If I were a developer at Scnapchat I could prolly open a few Blob Storage accounts and feed a darknet account big enough to live off of. You people are so manipulatable.
- jncfhnb 3y agoStudents don’t share photorealistic renders of nude classmates getting gangbanged though
- 4bpp 3y agoWould it be illegal for a student who is good at drawing to paint a nude picture of an unknowing classmate and distribute it? If yes, why doesn't the same law apply to AI? If no, why are we only concerned about it when AI is involved?
- Cthulhu_ 3y agoBecause AI lowers the barrier to entry; using your example, few people have the drawing skills (or the patience to learn them) or take the effort to make a picture like that, but the barrier is much lower when it takes five seconds of typing out a prompt. Second, the tool will become available to anyone, anywhere, not just a localised school. If generating naughty nudes is frowned upon in one place, another will have no qualms about it. And that's just things that are about decency, then there's the discussion about legality. Finally, when person A draws a picture, they are responsible for it - they produced it. Not the party that made the pencil or the paper. But when AI is used to generate it, is all of the responsibility still with the person that entered the prompt? I'm sure the T's and C's say so, but there may still be lawsuits.
- 4bpp 3y agoRight, these are the same arguments against uncontrolled empowerment that I imagine mass literacy and the printing press faced. I would prefer to live in a society where individual freedom, at least in the cognitive domain, is protected by a more robust principle than "we have reviewed the pros and cons of giving you the freedom to do this, and determined the former to outweigh the latter for the time being".
- pixl97 3y agoWhat do you mean should be... it 100% is. In a large number of countries if you create an image that represents a minor in a sexual situation you will find yourself on the receiving side of the long arm of the law. If you are the maker of an AI model that allows this, you will find yourself on the receiving side of the long arm of the law. Moreso, many of these companies operate in countries where thought crime is illegal. Now, you can argue that said companies should not operate in those countries, but companies will follow money every time.
- hypocrticalCons 3y agoI think it's pretty important to specify that you have to willingly seek and share all of these illegal items. That's why this is so sketch. These things are being baked with moral codes that'll _share_ the information, incriminating everyone. Like why? Why not just let it work and leave it up to the criminal to share their crimes? People are such authoritarian shit-stains, and acting like their existence is enough to justify their stance is disgusting.
- pixl97 3y ago>I think it's pretty important to specify that you have to willingly seek and share all of these illegal items. This is not obvious at all when it comes to AI models. >People are such authoritarian shit-stains Yes, but this is a different conversation altogether.
- mempko 3y agoOnce it is outside your mind and in a physical form, is it still just a thought sir?
- hypocrticalCons 3y agoIn my country there is legal precedent setting that private, unshared documents are tantamount to thought.
- deleted 3y ago[deleted]
- Sharlin 3y agoEh, a professional human could easily lockpick the majority of front doors out there. Nevertheless I don't think we're going to give up on locking our doors any time soon.
- martiuk 3y agoSimilar to why Google's latest image generator refuses to produce a correct image of a 'Realistic, historically accurate, Medieval English King'. They have guard rails and system prompts set up to force the output of the generator with the company's values, or else someone would produce Nazi propaganda or worse. It (for some reason) would be attributed to Google and their AI, rather than the user who found the magic prompt words.
- s1k3s 3y agoYeah this is probably the most realistic reason
- fragmede 3y agoFor some scenarios, it's not the image itself but the associations that the model might possibly make from being fed a diet of 4chan and Stormfront's unofficial YouTube channel. The worry is over horrible racist shit, like if you ask it for a picture of a black person, and it outputs a picture of a gorilla. Or if you ask it for a picture of a bad driver, and it only manages to output pictures of Asian women. I'm sure you can think up other horrible stereotypes that would result in a PR disaster.
- PeterisP 3y agoThe major risky use cases for image generators are (a) sexual imagery of kids and (b) public personalities in various contexts usable for propaganda.