A paper was recently released for that particular use case (https://github.com/markriedl/weirdai https://github.com/markriedl/weirdai), in which it describes a

A paper was recently released for that particular use case (https://github.com/markriedl/weirdai https://github.com/markriedl/weirdai), in which it describes a number of technical caveats (and it's technically not using GPT-2). I do think it's possible to train a GPT-2-esque network to do something similar, albeit with some text encoding shenanigans.