Humans become intelligent after reading / hearing several orders of magnitude fewer words than GPT-3 has access to. There's dozens of ways GPT-4 could be impro

Humans become intelligent after reading / hearing several orders of magnitude fewer words than GPT-3 has access to. There's dozens of ways GPT-4 could be improved over GPT-3 without needing more training data. Eg, through reinforcement learning (talking to itself), tweaking the neural architecture, spending more time training, etc.