Yes but due to the nature of ML trained tools that isn't as straightforward as it would otherwise be. OpenAI has gone to great lengths to try and fence in ChatG

Yes but due to the nature of ML trained tools that isn't as straightforward as it would otherwise be. OpenAI has gone to great lengths to try and fence in ChatGPT from undesirable response but you can never do this completely. Some of this testing is just that, people probing for the limitations of the model. But a lot of it does seem like people are misusing the software and aren't aware of it. A contributing factor may be how ChatGPT has been portrayed in media in regards to its purpose and capability. As well as people ascribing human-like thinking and emotions to the responses. This is a Chinese room situation.