> The tonal and structural similarity is so glaring that I have often wondered if a large percentage of the GPT training corpus is made up of text from spam blo

> The tonal and structural similarity is so glaring that I have often wondered if a large percentage of the GPT training corpus is made up of text from spam blogs. This is almost certainly the case, because the shifts in tone and vocabulary between an Inc.com or Buzzfeed article vs a London Review of Books article is far too wide to allow an AI to simply weigh them equally. AI speaks a kind of global English that's been trained on not just blogs and Wikipedia, but also Quora answers and content marketing pieces, a lot of which is written by non-native speakers. It isn't grammatically wrong, but as it targets the widest possible audience, its voice also isn't very interesting.