3 ms·
Scaling in this broader context can have many meanings. All of them disagree with the original statement and with yours. If you assume that OpenAI spent more on
by pama 3y ago
Scaling in this broader context can have many meanings. All of them disagree with the original statement and with yours. If you assume that OpenAI spent more on GPT3.5 than on GPT3, and more on GPT4 than on GPT3.5, which is certainly plausible, how do I understand your statement in that view? What is even meant with scaling stopping at GPT4 when the next model by OpenAI is not yet public? Of course it makes no sense to compare against yet another company throwing money at a problem, but within each company scaling to more money (training/modalities/tunings) as a function of time has improved reasoning abilities. I am probably misunderstanding something simple so any citation would help.