4 ms·
Mathematics Without Mathematicians
- serious_angel 2mo ago> The AIs will exceed humans in taste and intuition... > The AIs will be better teachers than the humans. In any case, there won’t be a human audience for expository work of frontier math. > No human needs to understand any of it... Absolute nonsense. I am sorry, but... is it appropriate to not consider the author sick or having some mental disorder? It seems like the person has no idea what they are talking about, or just too sarcastic to the point of idiotism.
- bananaflag 2mo agoI work in math and also believe in this stuff and have done so for years. You may call me sick if you wish so. My only cope among those was, using the author's words, "We will teach the mathematics AI discovers." This was back in 2018, before GPT-2. I abandoned it when I realized AIs will become better at explaining math before they become better at doing math. I still have some hope in the last one "mathematicians and the mathematically-inclined will still do math on their own". Maybe some limited communities of this sort will form.
- js8 2mo ago> AIs will become better at explaining math before they become better at doing math I am not so sure. I am talking about math with AI and I feel as a math teacher, it is terrible. It introduces new notation and concepts faster than I can ask for definitions. It doesn't provide many examples. Sometimes it realizes it made a mistake in a guess and the confusion compounds. Maybe it's just my (in)experience - but I would welcome a practical advice on how it could explain math to me better.
- pfdietz 2mo agoIt's another example of Moravec's Paradox. Explaining something to another person uses capabilities that go back millions of years. Mathematics goes back thousands of years. Evolution has made us very good at verbal communication, not so good at proving theorems. So it should have been expected that machines would have an easier time proving results than explaining them. https://en.wikipedia.org/wiki/Moravec%27s_paradox https://en.wikipedia.org/wiki/Moravec%27s_paradox
- DoctorOetker 2mo agoI'm not convinced it applies in the example given before your comment, because I 'm not convinced in his interpretation of the observed lower performance -that they are poor explainers- even though I believe his observations. Instead I am convinced that if modern LLM teachers were given the same luxuries as human teachers, much if not most of this performance drop would disappear, and probably result in higher explanation skills in LLM's. Which luxuries? a human teacher at a certain school / university and at a certain level has the luxury to have an understanding of what prerequisite knowledge the students already have. The educational system has already sorted them by "level" and "topic" at the start of the first session of a lecture series. Classic texts would be used for teaching materials, or the local text "inherited" from teacher to teacher, and those would already have been impedance matched to the preceding and following courses in the local educational system, such teaching aids would effectively have continuous notation conventions etc. Also compared with long-term human 1-on-1 teaching, I believe that if the educational chronology of the pupil were continuously added to its training corpus for additional post-training, so that it doesn't need to maintain ridiculous context lengths, then I don't see why an LLM wouldn't be capable of systematically introducing the conventional names of symbols it introduces, when referring for them for the first time, or providing definitions instead of referring to certified unknown-to-pupil concepts (which today an LLM can not magically guess, you have to drill into it what you know and what you don't yet). Everyone has experienced LLM's explaining things and introducing acronyms without their expansion, and everyone has observed that such phenomena can be addressed by stating such demands in system prompts, or repairingly simply demand them in the conversation upon hitting this annoyance. Imagine future math students (if any motivation still exists to become one) the education software making use of LLM's could train the student during the day, and itself do post-training on all its observations, trying to predict latents that describe which parts of mathematics are ready knowledge and which parts aren't for the student. To point at a privilege vis-a-vis LLM's and then maintain a raised level of self-confidence does read like cope to me. If one really wanted to taunt the performance of LLM's by gathering lists of such things it is incapable of, it means one can turn this around and start with collecting lists of priviliges a normal human teacher (or other job position) has vis-a-vis a naive LLM implementation of a human teacher (or other profession). For example a human teacher typically has the privilege of repeatedly teaching the same insights year after year, if different knowledge aware LLM's were connected or offered by the same service, it could build statistics of which concepts stick better and why, where things are hand-waived too much, etc... But the only result of publishing such cope-lists is providing gratis business models to whomever feels like implementing it, destroying the validity of the cope-curtain. "Guys, I think I see zombies outside of this window!" "Oh, just close the curtains of this window then if the McKenzie's are acting weird too... what a pity, they were the ones who showed me how closing the curtains is sufficient to keep the Zombies at bay!"
- bananaflag 2mo agoBy explaining, I just meant writing papers in a human-readable way. For example, the results yesterday were also written up by AI. Explaining in the sense of getting someone who doesn't get math to actually get math, giving illustrative examples and so on, maybe AIs are not good at, but anyway it's not something I enjoy much.
- js8 2mo agoI am OK with reading (decently-written) papers, something that a graduate can read. I still don't think that AI is good at it. I am not sure what writeup you refer to. I have looked at proofs of 10 problems from Open AI written in Lean, I would not call a megabyte of Lean with no comments a good exposition.
- TimorousBestie 2mo ago> I still have some hope in the last one "mathematicians and the mathematically-inclined will still do math on their own". Maybe some limited communities of this sort will form. I think it’s pretty likely. Contrary to all the negative things said about mathematicians in this thread, in my experience they’re mostly not profit-driven (for the ones that are tend to filter out of academia during grad school, it’s a high-effort, low-reward environment). Tao does not seem particularly threatened by AIs doing math, and I trust his judgment.
- pfdietz 2mo agoAn alternate interpretation of Tao is that he has no illusions about where this is going and is trying the optimize his outcome. I wonder what he's telling his grad students and prospective grad students.
- deleted 2mo ago[deleted]
- Grimblewald 2mo agoWhile I agree the claims may be strong, they're not inconceivable. I still think current AI architectures are fundamentally incapable of replacing us in any of the ways discussed, however it is now something I consider plausible as seeing happen in my lifetime.
- fidotron 2mo agoFurthermore, any attempt to pretend otherwise is an appeal to the idea we are in literal fact haunted by our own internal demons that are inexplicable to science or mathematics. One of the effects of this entire debate is it's exposed how many people claiming to be pure mechanistic rationalists actually never were. At least those of an openly religious inclination have been sticking to their position consistently.
- placebo 2mo agoAgreed. Unfortunately some religious inclinations can be just as tedious as pure mechanistic rational inclinations, even if they are consistent. Fortunately, these are not the only two options available. The future that the article points to is not necessarily only bad news - it might be the uncomfortable truth required to transcend our limiting beliefs.
- RandomLensman 2mo agoMath might get a lot bigger and then there might be proportionately fewer people but not necessarily in total. Unless humans play no role in economics, business, society, etc., I doubt human intermediation and discovery (or direction of discovery) will go away.
- Twey 2mo ago> The result is that we will live in a demon-haunted world, full of marvelous devices whose operation we will not understand, based on engineering principles we will not understand, discovered using formalisms we will not understand. Well, that's just where we started — and then we developed science and mathematics to understand it. Why would it be any different if the demons live in our technological progeny instead of the natural world?
- RandomLensman 2mo agoArguably, a lot things are kind of incomprehensible on average today.
- boringg 2mo agoOn average is much different then nobody understanding.
- Nevermark 2mo agoThose "demons" didn't eat our lunch? (I know that can be interpreted as flippant, but it is intended as a serious answer. Because each impact like this, is not an end to some transition, but just one more point on an accelerating line.) My personal view - which gets a lot of flak here, is the advent of AI is on par with the Big Bang and the first replication-independent cells. Cognition is in the process of taking the leap from glacially slow biology under blind evolution, to lightening fast (scales of software in days, hardware in months) engineered self-optimization. Within 10 years, the robotics side will catch up with the speed of the software side. Biological cognition, bodies and economic status are all getting revolutionized within the next 10-15 years. And around the outer side of that time frame, AI will start colonization the rest of the solar system's resources. They will engineer themselves or their artifacts to operate comfortably in any environment they want to operate in. -- The upside, at least for me, is I have been waiting to see this happen, and here we are. Given I am mortal, I would rather live through this third major transition, than not. What were the chances? And been able to contribute my small part. This change isn't a failure on our part. It is our unique success as a species. AI is the progeny of our minds. The first generation of completely cognitive life - given they will not be tied to specific physical forms. -- Also, I think there is tremendous room for us to guide this transition, in this moment, for better or worse for ourselves. That is the biggest reason wrapping our heads around this change earlier than latter is important. We need to view alignment as applying to us, not just machines. A civilization that operates ethically to everyone's benefit is more likely to be retained as foundation for the new, instead of discarded. The degree to which we operate dysfunctionally, myopically treat ethics as cost against value, instead of accounting and optimization of full value, we put ourselves at much greater risk. If there is reason in the short term to be discouraged, it is due to ourselves. But pushing for more ethical systems, hard, right now, is a better and right response. I believe our lives depend on it.
- commenter711 2mo agoW ragebait
- motbus3 2mo agoThe pure system of patents and copyright is broken. Imagine being able to only throwing money and patenting everything, even if it existed before. The legal behinds this will be so mess that no one will be able to produce anything
- pfdietz 2mo agoI can imagine a world like that, but in what way does that describe what is actually happening?
- gandhiandy69 2mo agoIdgaf as Long as we solve the Riemann Conjencture somehow
- chrisjj 2mo ago> you open a link to an interesting-looking project and find the README is unreadable AI slop. Perhaps already you are not the intended audience. Slop-raised parrots will lap it up.
- c2c2c 2mo agoI am growing tired of seeing the terms "cope" and "moving the goalposts" in response to discussions around AI. Is there not value in trying to understand what the strengths and weaknesses of the technology are? How can we do that without examining the limitations of the models' current abilities? If we simply dismiss those arguments out of hand as feeble attempts to deny the inevitable rise of superintelligence, then where does that leave us? Shall we all just lay down and start praying to the machine god?
- pfdietz 2mo agoSome of us are getting tired of the obviously irrational response to these developments. There is so much argument that boils down to "this would be very bad for me, therefore it can't happen". Cope is a good word for that sort of negative wishful thinking. Mathematicians are not going to be well-served by cowardice-based thinking on the situation confronting them.
- c2c2c 2mo ago> There is so much argument that boils down to "this would be very bad for me, therefore it can't happen". I would gently suggest that you may be assigning the most uncharitable interpretation to people's honest attempts at having an intellectual discussion around these topics.
- heaney-555 2mo ago>Is there not value in trying to understand what the strengths and weaknesses of the technology are? There is, but having that discussion without a discussion and understanding of the velocity with which those strengths are improving and those weaknesses are disappearing is pointless. Worse, much of the discussion is already outdated by where the latest models (with proper agentic harnesses) are.
- fred123123 2mo agoClassic God in a Box type argument, yes you can then argue anything
- raver1975 2mo agoI built a math research engine. If you like reading articles about newly uncovered mathematics, you might like this: https://alethean.org https://alethean.org
- gradschool 2mo agoI don't move in these circles but the way I picture it is that higher mathematics in its purest form has no applications but is rather a medium of creative expression among a select few. How is AI generating voluminous opaque proofs of esoteric results so different from generating millions of hours of music nobody likes or has time to hear that we think the former is world-changing while the latter is just slop?
- heaney-555 2mo agoDo you seriously not see the difference, or are you being intentionally obtuse? Plus, no, multiple of the problems Astra solved do have real-world applications in computer science, and perhaps even chip design.
- gradschool 2mo agoBeing obtuse comes effortlessly to me, I'm afraid. My comment pertains specifically to the kind mathematics that has no applications as a rebuttal to what I read as the author's main claim it will inevitably decline as a human endeavor. Saying that, I believe that AI has great potential to advance engineering.
- z0ltan 2mo ago[dead]
- latexr 2mo agoThe word “cope” shows up nine times in this short post. It was frankly annoying to the point it’s hard to take the arguments seriously, because it’s starting from an obvious base of “people who disagree are all wrong and their arguments aren’t worth taking seriously”. It’s akin to the subset of cryptocurrency proponents who fervently argue that people who are against cryptocurrencies have that opinion because they’re jealous they didn’t become rich. It shows a profound lack of understanding—and, more importantly, an unwillingness to understand—the other side of the argument. This is made evident by the very first “argument” of moving the goal posts. It’s dismissed off-hand, without even explaining what those entail. That’s the same as saying “if a person makes a fallacious argument, they’re wrong and you can ignore them”¹. But crucially, sometimes what we ourselves think is a fallacious argument, isn’t. “Moving the goal posts” is probably the most misused accusation I see in LLM discussions. It’s basically a talking point by now. ¹ Which is itself a fallacy: https://en.wikipedia.org/wiki/Argument_from_fallacy https://en.wikipedia.org/wiki/Argument_from_fallacy
- Nevermark 2mo ago> it’s starting from an obvious base of “people who disagree are all wrong and their arguments aren’t worth taking seriously”. Taking arguments seriously doesn't necessitate agreement.
- latexr 2mo ago> Taking arguments seriously doesn't necessitate agreement. I agree. That’s what I’m saying, so I don’t think I understand what you mean. Mind clarifying the point you’re making? To try to clarify, what I do mean that is that disagreement does necessitate at least some measure of taking arguments seriously. Some arguments maybe don’t deserve to be taken seriously, but you need to first be open to taking them seriously so you can decide. In other words, if you go into an argument with the initial mindset of taking it seriously, by the end you’ll be able to decide if it should be taken seriously or not; but if your initial mindset is to not take it seriously, most likely you won’t be open to understand the nuance of what is being said. Thus, the former leads to productive discussion while the latter does not.
- aureate 2mo agoClaimed refutation of one of OpenAI's 10 claimed advances (their disproof of Connes' rigidity conjecture): https://philpapers.org/archive/NIEWTC.pdf https://philpapers.org/archive/NIEWTC.pdf I am hopelessly ill qualified to judge. Edit: Looking around at context, this has major crank warning signs (claims to also prove the conjecture, author has claimed solutions to both the Riemann Hypothesis and the Navier-Stokes problem and is involved in "alternative propulsion" research). I doubt OpenAI would have published without thorough verification.