It gives us nonsense because it's goal is to generate something that looks like it fits in with training data. You can have training data that is all completely

It gives us nonsense because it's goal is to generate something that looks like it fits in with training data. You can have training data that is all completely factual and still have a generator spit out nonsense that looks completely correct without fact-checking.