It is the same problem as with all the AI models that are “racist” (note some are actually racist or insensitive): the AI model just does what it’s told, doesn’

It is the same problem as with all the AI models that are “racist” (note some are actually racist or insensitive): the AI model just does what it’s told, doesn’t know right from wrong, and amplifies fake and actual differences in ways that make us uncomfortable. So you can get an AI model that hasn’t been hardened against these attacks to write a paper on why <racist thing> or create an image depicting <racist or porny thing> and it just does it. Because the model is just an input:output device and doesn’t have the “wait maybe I shouldn’t do that because it’s bad” feature. And while teen and young 20 something males will get a huge laugh out of posting screenshots of it, the journalist crowd will freak out and start calling the model, researchers, and company racist. Personally I have played with large language models and the chutzpah with which they will lie and make things up is indeed astounding (they do a good job at making them sound believable, and lie with utter seriousness and confidence). So I can see where the controversy comes from, although I agree with the other commenters that the researchers should be able to put up a bit fat disclaimer about it