I did something sort of similar, but really most similar to the "manual tagging" you described... I wrote an "Excuse Generator" that takes the form of "I wanted

I did something sort of similar, but really most similar to the "manual tagging" you described... I wrote an "Excuse Generator" that takes the form of "I wanted to do ___ but didn't because __ and I feel terrible about that because ___". The actual code takes a few more randomized turns in the structure than that, but ends of making some stuff that amazed me. Code: https://github.com/unoti/gpt2-excuse-generator https://github.com/unoti/gpt2-excuse-generator