3 ms·
It does make for a good comic so I won't criticize it on that basis. I just wish we could stop with the vagueness of "make image generation safe" which is compl
by Spivak 3y ago
It does make for a good comic so I won't criticize it on that basis. I just wish we could stop with the vagueness of "make image generation safe" which is completely meaningless and instead phrase as a concrete problem like actual engineers.
Something like, "AI generated images present a difficult challenge for applications that require that sensitive content be removed (e.g. Tumblr) or hidden (e.g. Discord) due to the fact that the abstract nature of the generation can trick most digital 'eyes'. To that end we've invented new measures based on already established content warnings and created a large corpus of prompts that have semantic relationships with those warnings. We've asked our labelers to measure content in the context of those content warnings; for example, an image might be labeled "is of a sexual nature", or "is of a violent nature." These responses are summarized as the scores on Figure 1. Going forward we will be making continuous improvements to our moderation API to identify such images with higher accuracy and future models will be tuned to generate them with lower frequency. We understand that a portion of our existing user-base desires the ability to generate sensitive images specifically but it is our goal as a company to build a product that can be deployed in a wide variety of applications without the need for human supervision. At some point down the road we may look into releasing models that cater to that use-case but at present our efforts are elsewhere."
- AbrahamParangi 3y agoPart of the reason this doesn't happen is that the word "Safe" smuggles in some ideas that an average person might object to alongside many unobjectionable ideas. For instance, "Safe" might mean "enforce a certain distribution of characteristics like skin color or apparent gender" or it might mean "don't make child pornography".
- raxxorraxor 3y agoEspecially in a context where we have increased security policies for decades now while simultaneously living in the safest time there ever was. People even start to make up dangers which in some instances can only be explained as a pathological condition. And no, these security policies had no hand in increasing security if you look at the actual data. They were mostly political to alleviate imagined fears.
- hiatus 3y agoThe entire point of the comic IMO is that safety is inherently an ideological/cultural construct that will vary greatly across populations, in the same way that even something as seemingly unambiguous as sexual imagery can be interpreted through multiple lenses, depending on your kink.