they are actively saying 4 represents hitting a limit point for the current models, and that further progress needs different model structure not just more size

they are actively saying 4 represents hitting a limit point for the current models, and that further progress needs different model structure not just more size and training compute. a lot of people are hopeful for the fine tuning but i am sceptical that qualitatively better thinking will happen thru fine tuning, but we'll see