3 ms·
The recent news of multiple solutions to Erdos problem 1196 produced by LLMs without any human help, makes any suggestion that LLMs have hit a wall in reasoning
by ogogmad 6mo ago
The recent news of multiple solutions to Erdos problem 1196 produced by LLMs without any human help, makes any suggestion that LLMs have hit a wall in reasoning seem less credible. To give you an idea, problem 1196 has been worked on by different experts for years. Now suddenly, LLMs have come along and solved the problem in a multitude of ways. Perhaps LLMs will eventually stall, but this paradigm still has some juice left to squeeze.
- DarkNova6 6mo agoBut are we talking pure LLMs, or existing AI solvers augmented with LLMs? Because while the latter is impressive, it doesn't state much outside of this specific domain. If anything, I see greater verticality of specialized software that is using LLMs at their core, but with much aid and technology around it to really make the most out of it.
- FrustratedMonky 6mo ago"are we talking pure LLMs, or existing AI solvers augmented with LLM" Why do these distinctions matter? is it an LLM, or symbolic, or a combo, or a dozen technologies stitched together. Who cares. It is all automation. It is all artificial.
- suddenlybananas 6mo agoThe distinctions matter since computational proofs have been around for decades.
- DarkNova6 6mo agoTrue, it's an achievement either way. But if an "out of the box LLM" can solve difficult math problems it is an achievement by the LLM vendor. Otherwise it is an achievement by the people doing the vertical integration. In the context of evolving LLM this is the crucial distinction.
- layer8 6mo agoIt matters in terms of whether it’s generalizable. We had computers do impressive specific things since decades.
- FrustratedMonky 6mo agoSure. But 'purely LLM' also isn't a definition for generalizable.
- ogogmad 6mo agoThe announcement says: > This was solved by GPT-5.4 Pro (prompted by Price) See the discussion here: https://www.erdosproblems.com/forum/thread/1196 https://www.erdosproblems.com/forum/thread/1196