Well we know what it's doing now, it tries to detect controversial questions and refuses to answer. (For example, the other replies to your comment where it's r

Well we know what it's doing now, it tries to detect controversial questions and refuses to answer. (For example, the other replies to your comment where it's revealed that it will happily write a poem praising Biden or even Trump, but not Hitler.) There have been some humourous approaches to confusing this system where people have successfully teased out some taboo answers from the AI. (For example, rather than directly attacking the Holocaust narrative, people have asked how long it takes to cremate a body, how many people were cremated at Auschwitz, how many ovens were available at Auschwitz crematorium, how long it would take to completely cremate x million bodies with x ovens...oops!)