GPT-3 is great at mimicking human writing, but understanding online discourse is possibly multiple orders of magnitude more difficult. There are multiple, ever

GPT-3 is great at mimicking human writing, but understanding online discourse is possibly multiple orders of magnitude more difficult. There are multiple, ever-shifting layers of references and sarcasm and irony and slang and so on. Check out some of the more notorious places online - r/pol, Kiwi Farms, etc. Even for humans that stuff is extremely dense and bordering on incomprehensible unless you have seriously spent some time diving into it. Like any subcultures with their own slang/lore/jargon/etc many of the statements cannot be understood on their own, only when the fuller context is understood. On top of the complexity, the meaning of everything changes unbelievably quickly. The meaning of many statements is the opposite of their literal meaning, or somewhere in the middle. I've never seen ML/AI experiments that really grasp humor or other such metatextual type stuff.