To my understanding the “chat” part means the entire context of the conversation becomes a conditional to the next prompt (forgive me if I used the wrong term),

To my understanding the “chat” part means the entire context of the conversation becomes a conditional to the next prompt (forgive me if I used the wrong term), so in a sense it can be trained in the convo. You can definitely gas light it, including building up a context that subverts it’s guard rails. A lot of focus is on the one shot subversion but you can achieve it too more subtly.