GPT1 through GPT3 advancement were exactly like using more Ethernet cables in parallel. All interesting conceptual breakthroughs came after GPT3: RL and reason

GPT1 through GPT3 advancement were exactly like using more Ethernet cables in parallel. All interesting conceptual breakthroughs came after GPT3: RL and reasoning being the main ones.