I don't think this is true at all and it suggests a view on what GPT is that I think is very incorrect. Not to rag, it's just a common POV. GPT does not attemp

I don't think this is true at all and it suggests a view on what GPT is that I think is very incorrect. Not to rag, it's just a common POV. GPT does not attempt to learn the average "text-generating system". It attempts to learn all of them. In superposition. Just imaging how bad it would be at predicting a scientific paper if it spoke (and reasoned?) like the average person. Such a model would not survive training. Training GPT does not make it behave more like the average, but instead widens and diversifies its probability distribution over all possible follow-ups. To make this clear, ask it to take on a persona. It can pretend to be all sorts of people, invented or sufficiently catalogued. I've had fun having it play multiple roles from podcasts I enjoy. Or it can pretend to be a fictional FTP server at Disney where poor authors have stored their unpublished screenplays. You can ask GPT to run dialogues with itself, playing both sides of the argument. There likely is some level of global persona at play, either through fine tuning or there being a general attractor basin of "helpful assistant" that we're all reinforcing. But there's no reason to believe that this looks anything like consensus or averaging.