3 ms·
The proof is that LLMs could barely solve arithmetic 3 years ago, but now surpass the best human mathematicians, and that this has all occurred from simple prin
by x312 26d ago
The proof is that LLMs could barely solve arithmetic 3 years ago, but now surpass the best human mathematicians, and that this has all occurred from simple principles (RL + compute) that will continue to scale up by factors of millions in the coming years.
Also, advocating for slowing LLM progress does not benefit Anthropic or OpenAI.
- platinumrad 26d agoThey surpass the best human mathematicians in one specific way: they don't get tired or bored.
- xyzsparetimexyz 26d agoIt won't scale up by factors of millions, that's just obscene hyperbole. Since chatgpt we've probably made things 10x more intelligent on the same hardware. We've also made way more expensive models. Maybe we get a maximum of another 10x efficiency and 5x model size/expense from this point but millions is a joke.
- EA-3167 26d agoHaven't people learned about the peril of assuming, "Line go up" yet?! TRENDS HAVE FEEDBACK
- skybrian 26d agoTrends don't go on forever, but the market can stay irrational longer than you can stay solvent. There's no good rule of thumb for this, other than maybe the Lindy effect.
- EA-3167 26d agoI won’t presume to time it, but at this point I think anyone can see what’s coming. It’s precisely because it can’t be timed that a sane person should stand well clear.
- skybrian 26d agoI certainly can't see what's coming. I believe that nobody really knows what's coming. Some people are overconfident.