3 ms·
> The blind trust OpenAI and competitors like Google, Anthropic, or Meta put on the scaling laws—if you increase size, data, and compute you’ll get a better mod
by thornewolf 2y ago
> The blind trust OpenAI and competitors like Google, Anthropic, or Meta put on the scaling laws—if you increase size, data, and compute you’ll get a better model—was unjustified. And how could it be otherwise! Scale was never a law of nature like gravity or evolution, but an observation of what was working at the time—just like Moore’s law, which today rests in peace, outmatched by the impenetrability of quantum mechanics and the geopolitical forces that menace Taiwan.
This is a self-contradicting paragraph. It cites quantum mechanics understanding as breaking down Moore's law while ignoring the fact that it has implications on our so-called "laws" of physics in just the same way.
I can imagine the author having originally written "physics" instead of "gravity" but needing to re-write the paragraph to squirm away from the contradiction they set up for themselves. I feel that this presentation is not intellectually honest.