4 ms·
That seems a real stretch. GPT 5 just invented new math for reference. What you are saying would be equivalent to saying that this math was obviously in some pa
by rowanG077 1y ago
That seems a real stretch. GPT 5 just invented new math for reference. What you are saying would be equivalent to saying that this math was obviously in some paper that mathematician did not know about. Maybe true, but it's a far reach.
- jakelazaroff 1y agoThis would be the first time ever that an LLM has discovered new knowledge, but the far reach is that the information does appear in the training data?
- ants_everywhere 1y agoThey've been doing it for a while. Gemini has also discovered new math and new algorithms. There is an entire research field of scientific discovery using LLMs together with sub-disciplines for the various specialization. LLMs routinely discover new things.
- jakelazaroff 1y agoI hadn't heard of that, so I did some searching and the single source for the claim I can find is a Google white paper. That doesn't automatically mean it's false, of course, but it is curious that the only people ostensibly showing LLMs discover new things are the companies offering the LLMs.
- tovej 1y agoCitation needed, and I call bullshit. Unless you mean that they hallucinate useless algorithms that do not work, which they do. LLMs do not have an internal model for manipulating mathematical objects. They cannot, by design, come up with new algorithms unless they are very nearly the same as some other algorithm. I'm a computer science researcher and have not heard of a single algorithm created by LLM.
- deleted 1y ago[deleted]
- rerdavies 1y agohttps://medium.com/@deshmukhpratik931/the-matrix-multiplication-revolution-how-alphaevolve-shattered-a-56-year-mathematical-record-c9e61b70bae2 https://medium.com/@deshmukhpratik931/the-matrix-multiplicat... And it's not an accident that significant percentage (40%?) of all papers being published in top journals involve application of AIs.
- jakelazaroff 1y agoThis article is about the same thing I mentioned in a sibling comment. I personally don't find an unreplicated Google white paper to be compelling evidence.
- rerdavies 1y agoIt's a fast matrix multiply! (A decades-old human problem). What exactly do you need to replicate??! Just count the multiplies, fer goodness sake.
- jakelazaroff 1y ago> What exactly do you need to replicate??! The AI coming up with it? When Google claimed their Wizard of Oz show at the Las Vegas Sphere was AI-generated, a ton of VFX artists spoke up to say they'd spent months of human labor working on it. Forgive me for not giving the benefit of the doubt to a company that has a vested interest in making their AI seem more powerful, and a track record of lying to do so.
- postexitus 1y agoIt invented "new math" as much as I invented "new food" when I was cooking yesterday. It did a series of quite complicated calculations that would take a well trained human several hours or even days to do - still impressive, but no it's not new maths.
- const_cast 1y agoNew math? As in it just fucking Isaac Newton'd invented calculus? Or do you just mean it solved a math problem?
- rerdavies 1y agoAn example: https://medium.com/@deshmukhpratik931/the-matrix-multiplication-revolution-how-alphaevolve-shattered-a-56-year-mathematical-record-c9e61b70bae2 https://medium.com/@deshmukhpratik931/the-matrix-multiplicat... Obviously not ChatGPT. But ChatGPT isn't the sharpest stick on the block by a significant margin. It is a mistake to judge what AIs can do based on what ChatGPT does.