No matter how much the speed of development increases, the problem becomes significantly harder with a limit to how much transformer based models can do. There

No matter how much the speed of development increases, the problem becomes significantly harder with a limit to how much transformer based models can do. There is a reason why you aren't seeing GPT-4 despite the rapid progress we saw with previous iterations. Or just take a look at the speed of RL development and how that turned out.