5 ms·

Does it matter? It's going to produce proofs far more intricate than humans can understand, outdoing humans and opening new frontiers. The age of humans compre

• jansport123 2mo ago
  That maybe true at some point, but i don't think we are there yet.
  • a2ff6eeb0 2mo ago
    Yeah, it's probably a few years out.
• mettamage 2mo ago
  But apparently we can teach machines to do it for us
  • a2ff6eeb0 2mo ago
    Yeah. We can also teach machines to move hundreds of miles an hour, but we could never do it ourselves.
• orphereus 2mo ago
  "The age of humans comprehending things is coming to an end" That's something AI companies would really want you to believe.
  • ianm218 2mo ago
    > That's something AI companies would really want you to believe. Why would I care what they want me to believe? Intuitively it would make sense that you can put math ability on a chart with a value for “general public” “smart high schooler” “smart undergrad” “smart PhD/ professional”. And you could place frontier AI somewhere on that chart over time from GPT 2 to now and see the trend. Then you’d have to consider that either you believe there is a fundamental limit that is below peak human mathematician level or there’s not.
    • orphereus 2mo ago
      > Why would I care what they want me to believe? How would you not care? Are you a robot? They can say random stuff with the goal of increasing their shareholder value. Things they spit out do not have to be true. It is not easy to verify things they say, therefore, everything they say should be taken with a huge grain of salt.
      • esafak 2mo ago
        He's saying he can connect the dots without their help.
        • orphereus 2mo ago
          Yeah, my bad.
      • ianm218 2mo ago
        Consider Enron and Amazon at the turn of the millennium. They were both telling you what the future would look like. The right action would’ve been to just ignore what they are saying and try and get data and reason about the world. It didn’t really matter that both Bezos and Jeff Skilling wanted you to believe various things - one was right and one was a scammer. So that’s what I’m doing here. For what it’s worth I find a lot of the AI people’s worldview very consistent. They believed AI would be the most important technology of our life times and committed their work to it. Some of these same people are total liars so yeah I won’t really hang onto their every word.
  • jambalaya8 2mo ago
    that does not make it not true, nor does it make those companies or their products not dangerous. I like looking at videos of animals that tear other animals apart and eat them; lion cubs are super cute; but that does not mean I want to be thrown into a cage with a model of a lion that has not been programmed to be disinterested when it is sated. AIs appear never sated; humans using or making AI wanting money, even less so. I suspect the AIs will understand the cost long before the humans will, not that anyone making money would care.
  • breadramen 2mo ago
    [dead]
• ChaseRensberger 2mo ago
  > It's going to produce proofs far more intricate than humans can understand, outdoing humans and opening new frontiers. I agree. > The age of humans comprehending things is coming to an end: our brains just won't have the capacity to make meaningful contributions to science, math, or technology. I don't know if I see this being true for quite a while, if ever.
  • logicchains 2mo ago
    > It's going to produce proofs far more intricate than humans can understand, outdoing humans and opening new frontiers. > I agree. There's an infinite space of possible statements and proofs. The only thing that makes certain proofs significant is that human mathematicians consider them significant; if AI came up with a proof of some statement that no humans could understand then no humans would bother investing further resources in building upon it, for the same reason we don't waste computational resources iterating over the infinite space of true statements in first-order logic.
• amluto 2mo ago
  In limited experimentation: AI will certainly make statements that are extremely intricate and hard to understand, in part because they're overcomplicated and in part because they use a bunch of unnecessary terminology. This is not to say that a human couldn't understand a streamlined version or that the AI would not be better if it made more streamlined statements to begin with. (I am not saying that everything mathematical that an AI produces is in any sense trivial.)
• deleted 2mo ago
  [deleted]
• logicchains 2mo ago
  >produce proofs far more intricate than humans can understand Math is not magic, a proof is just a series of applications of a set of rules on some axioms. A mathematician could understand any proof given enough time to study it; the only way for AI to make proofs that a human couldn't understand is by making really, really long proofs.
• chongli 2mo ago
  We don’t trillions of dollars in LLM investment to build things mathematicians don’t understand. We already have plenty of those, even from ancient times. As to your second point, Terry Tao already has an answer [1]: the proof isn’t the contribution, shared understanding is. This issue was already raised back when the four-colour theorem was proved. Machine proving and machine proof checking are useful tools but they don’t mean anything without the interpretative work and the communication necessary to build shared understanding. [1] https://news.ycombinator.com/item?id=49056620 https://news.ycombinator.com/item?id=49056620
  • a2ff6eeb0 2mo ago
    Why not? We build cranes to hoist weights construction workers can't lift. We build electron microscopes to measure things physicists can't see. Why is it so hard to imagine we can build tools to think thoughts we can't comprehend? If there's commercial value, I think it's inevitable. We don't fund mathematicians because it's cute when they understand a problem, but because their work tends to have applications with commercial value. The value can be captured without understanding the details.
    • chongli 2mo ago
      Can you give an example of an incomprehensible piece of writing (any writing, never mind a proof) that has commercial value commensurate with the costs involved here?
      • a2ff6eeb0 2mo ago
        Yeah, how many people do you think understand the Linux kernel in full? What percentage of the people using it to great commercial effect can understand it? How's your understanding of Schroedingers "An Undulatory Theory of the Mechanics of Atoms and Molecules"? You seem to be using the results of it as applied to semiconductor engineering just fine. And, I promise you, most semiconductor engineers haven't read it in full, they just accepted the results as passed on by several layers of teacher. I have a paper on routing algorithms, which I have attempted to read to my cat. I don't think my cat retained much, but they seem to be enjoying the cat food that got delivered using the results. I'd suggest that we're going to be a lot closer to the cat than the author of the paper when AI takes off.
• tene80i 2mo ago
  It’s possible, but there’s a difference between vastness and difficulty. Humans can’t compete with AIs on vastness of material they are familiar with, or the depth of effort they are willing and able to throw at a problem. But scale isn’t the only aspect of difficult scientific endeavours. There’s also theory. And advancements sometimes come through hard graft of knotting together many things. And sometimes they come through the revelation of a deeper truth, or a new framework, a fundamental insight. AI might help us reach the next level. But that doesn’t mean we won’t understand anything. It could be we have periods of vast intricacy we cannot follow, punctuated by profound elegance we (or at least experts) relatively easily can. And then the scaffolding we needed to get there falls away.
  • a2ff6eeb0 2mo ago
    I don't think that's true. Human intelligence is limited, and our brains are inefficient machines. The tools we built to replace muscles have mostly obsoleted raw strength for tasks like excavating earth. There's no reason to think we can't do the same for brains. And then we'll never need to think for a living again. Some people may want to do it as a commercially insignificant hobby, of course, the way people lift and compete in strongman competitions today. We'll have AI taking care of our needs, the way a good mother takes care of their children.
    • archonis 2mo ago
      A good mother doesn't raise children to be dependent upon her for all their needs. For this to actually work in a way that benefits our species, humans will need to become something else/next through their interaction with the technology.
      • a2ff6eeb0 2mo ago
        It's inevitable -- we won't have the machinery to compete, so we either have an aligned AI taking care of us, or we end up with a big problem. Anyways, sipping wine on the beach and doing puzzles when I feel like sounds nice.
• paretolaw 2mo ago
  If and only if that is actually true, then perhaps nothing matters. Until then, calling out shenanigans remains a noble art.
• rho138 2mo ago
  You’re prescribing elegance to a stochastic generator trained on the wealth of humanity, including 4chan. Let’s set our expectations a bit.
  • ryeights 2mo ago
    Your brain is a stochastic generator. Have you read 4chan?
    • AndrewDucker 2mo ago
      Your brain is not just a stochastic generator.
      • blovescoffee 2mo ago
        what is it?
        • AndrewDucker 2mo ago
          It also creates and updates models, uses those models to make predictions, and guides the stochastic generation by comparing the output to those models and reworks them in real time.
      • AndrewDucker 2mo ago
        It also creates and updates models, uses those models to make predictions, guides the stochastic generation by comparing the output to those models and reworks them in real time.
    • vhantz 2mo ago
      Whenever someone tell me they can be reduced to an LLM, I believe them. I see you and I believe you that you are qualitatively the same as a language model.
  • yen223 2mo ago
    Not sure if you're referring to LLMs or humans here
• fsmv 2mo ago
  The entire point of writing proofs is for advancing human understanding. A giant dump of symbols that passes the lean compiler is meaningless besides human beings understanding it.
  • nickysielicki 2mo ago
    was. Not is. Was.
  • variadix 2mo ago
    In the field of pure mathematics this might be true, but it has implications regardless for applied math, engineering, and physics.
  • esafak 2mo ago
    Is it the AI's fault we can't understand? If the GUT is beyond human comprehension does it matter less? We don't apply this reasoning to other animals or even to less capable humans. Besides, the robots may want to ponder maths for their pleasure.
  • Jtarii 2mo ago
    An AI may still be able to apply the results without humans understanding the proof.
  • pfdietz 2mo ago
    > The entire point of writing proofs is for advancing human understanding. Proofs also enable AIs to direct search and generate knowledge. Verifiability is immensely useful for keeping AI grounded. One might imagine AI generating enormous numbers of hypotheses and then trying to prove or disprove them, and then mine that data for new abstractions and heuristics.
    • fsmv 2mo ago
      But what does it mean? The theorems are just symbols in lean. The conjectures humans chose are carefully selected to be the questions that are interesting and relevant to our intuition about the real world. Math often doesn't have applications for hundreds of years and that application is only possible because people deeply understand it and how it applies to the real world. Generating an endless list of true statements doesn't really do anything, those things are already true regardless of whether someone has written a lean program to model them.
• js8 2mo ago
  Why would you want something you don't comprehend? How can you be sure it empowers you? I think perfect rationality doesn't exist, because it is rational to reject something that you don't understand. So rationality of a given physical system will always be bounded.
• fasterik 2mo ago
  You could be right, but you're making a lot of assumptions about how complexity, scientific understanding, and explanations scale. One of the features of a good scientific discovery is that it often simplifies and compresses things that were previously a bunch of scattered facts. Also, as AI systems improve they'll get better not only at making scientific discoveries, but also at producing understandable explanations.
• okamiueru 2mo ago
  > The age of humans comprehending things is coming to an end: our brains just won't have the capacity to make meaningful contributions to science, math, or technology. That sentiment makes me cringe. If you understand how LLMs work, you'd know it'll never be possible without a fundamental change in how these work. We're also supposed to be reaching that point, somehow, without the LLMs ever being intelligent (in the dictionary definition sense, not the "high reasoning model" marketing sense). Based on observations, the ones who are fooled by the supposed emergent properties, are just that, fools. Any sufficiently unintelligent agent will perceive transformer based LLM text predictors as possessing high intelligence.
  • tossandthrow 2mo ago
    Maybe you can enlighten us. In what way aren't LLMs able to make new contributions. LLMs in agentic harnesses are Turing complete. To my best knowledge, we don't know of any greater computational model that the brain is a part of, that LLMs are not.
    • pfdietz 2mo ago
      Obviously actual intelligence has an ineffable essential aspect, just like unicorn farts do.
    • okamiueru 2mo ago
      First of all, the argument isn't that LLMs (with I assume some automation) cannot be used in searching a problem space. I'm assuming this is what you're referring to, in terms of contributions? That's the part where LLMs are used as tools. Which there are plenty of places where they are useful. Also, do you know what turning completeness is? Why are you bringing that up here? The crowd that AI psychosis has brought to HN is interesting. But not in the "I'd love to learn more" kind
      • tossandthrow 2mo ago
        > That sentiment makes me cringe. If you understand how LLMs work, you'd know > But not in the "I'd love to learn more" kind I hope you are able to see the problem in your own communication here. Computation classes are interesting because they say something about fundamental capabilities. Two machine that are Turing complete are in theory able to carry out the same computations. They are isomorph mediums of computation. Regardless. Please keep it sober. If you think you know something, enlighten us. But don't just propagate out lies.
• dyauspitr 2mo ago
  Let’s not jump the gun. Where they are right now they can somewhat match our abilities. We haven’t even gotten to the point where they can self improve.
• palmotea 2mo ago
  > The age of humans comprehending things is coming to an end: our brains just won't have the capacity to make meaningful contributions to science, math, or technology. Ask yourself: is that really the world you want to live in? It's a world where people, all people, are sidelined. I think the happy ending of that path is something like Idiocracy. And the more likely ending is something like "automated capitalist economy without the people, because the people couldn't compete."
• bhaak 2mo ago
  Then it's pretty bad that LLMs don't understand anything. They don't know and can't know. Without an external source of input that corrects them, their output can never be verified.
• joe_the_user 2mo ago
  It's going to produce proofs far more intricate than humans can understand The thing is, some number of advanced proofs start out "too intricate for most mathematicians to understand" but many of these get rephrase and reframed until they're accessible to undergraduates. Hopefully, AI math can be guided to do that sort of reframing to increase the level of accessible math as well as extend the border of math.
• tim333 2mo ago
  >The age of humans comprehending things is coming to an end I'm sure humans will comprehend some things and not others just as now. They may be smarter than me but the Einsteins and the like already were. It may be that the cutting edge gets pushed by AI more than humans at some point though.