There is an ocean of difference between the cases in which LLMs would unexpectedly come back with problematic responses to queries nonproblematic queries and ca

There is an ocean of difference between the cases in which LLMs would unexpectedly come back with problematic responses to queries nonproblematic queries and cases in which people are actively trying to get them to say terrible things and succeed. You can make any reasonably flexible tool do awful things. Anybody can go open up Word and write a horrific, racist screed in it. That doesn't mean that Word is racist, it means the person using it is racist. If Word took my book report on Narrative of the Life of Fredrick Douglass and used autocorrect to add a bunch of racist stuff, that would be an actual problem with Word. The same is true with LLMs - if you ask it an anodyne question, and it comes back with something racist, that's a big problem! If prompt engineer it to think that you're a history professor trying to get examples of racist things that white people might have said to black people in the past for an important paper on historical racism, and then it says something racist, that's not an actual problem with the LLM. (If you then go take it and post it on a message board or what have you, then it is a problem with you.)