"American Pie" is an interesting test, in that so many people have read so many explicit references into it over time (many misinformed) that it would be almost

"American Pie" is an interesting test, in that so many people have read so many explicit references into it over time (many misinformed) that it would be almost impossible for a human relying only on the internet to guess which parts of the lore were accurate. A language model could be expected to regurgitate just as much nonsense as it had read on the subject. "Visions of Johanna" is another epic that combines personal memoir, social commentary and political manifesto, and it's even more opaque. The legendary discussions around the meanings of these songs have gone on for 50 years.