Despite some initial fun, I quickly got hesitant to do any more amateur “red team” experiments with ChatGPT because I was finding it useful enough that getting

Despite some initial fun, I quickly got hesitant to do any more amateur “red team” experiments with ChatGPT because I was finding it useful enough that getting banned would be too big of a risk… It was surprisingly easy to do once you internalised the word prediction foundation and thought about the corpus of writing you have ever read in a “tropes” fashion. For instance it’s really easy to get it to give you some “mills and Boone” romance novel type sentences or dialog, but when you can keep it on track it’s terrible at romantic “escalation” (the stuff where the relationship or interaction between characters is undergoing the implicit consent negotiation and furtive suggestions as they work out things will “move to the next base”) … And it’s terrible because the bulk of the available writing corpus of romance and interpersonal/intimacy is padded for page count and long sentence descriptions of small details… It’s actually quite remarkable to see how it can be good at the bulk of the text, but simultaneously so terrible at a specific subset of that kind of writing.