"It's more like a savant, who can generate random stories that have no bearing on reality." That's actually just a particular special case of how this model is

"It's more like a savant, who can generate random stories that have no bearing on reality." That's actually just a particular special case of how this model is used, where they use the model to predict "the rest" of a story. It is not the nature of the model itself, and it can be used for other things, such as compression or other NLP tasks.