I agree. One thing I think everyone may want to consider is that the current experiments with GPT-2 aren't necessarily the only way to use it. It's just that i

I agree. One thing I think everyone may want to consider is that the current experiments with GPT-2 aren't necessarily the only way to use it. It's just that it happens by its structure that feeding it "all the text up to this point" and asking it to generate the next words is really easy to make into a snazzy web demo. But you could also do things like try to set up a vector representation of some space and turn it loose on that. If it's prone to its mind wandering, you might be able to confine it to a particular place in the hyperspace or something. This may require more novel research (especially around how a human being finds the place they want to use in the rather complicated space) and a deep understanding of the algorithm, and perhaps it is impractical in the end. But it's at least something that could be tried. We are not confined to merely using it as a glorified chatbot as it has been.