3 ms·
Do people train those AIs on mathematical reasoning? I asked GPT3 to teach me about addition and subtraction and it produced pure garbage in very lecturing tone
by scotty79 4y ago
Do people train those AIs on mathematical reasoning? I asked GPT3 to teach me about addition and subtraction and it produced pure garbage in very lecturing tone.
I think mathematics is one field where AI could be actually immediately useful.
- ben_w 4y ago> Do people train those AIs on mathematical reasoning? They do. The GPT family is basically a very fancy autocomplete, so it’s mainly noteworthy because of how far something that limited can go, as it’s not even trying to be a fully general NLP system. If you want to solve maths problems, there are many better choices; I often use WolframAlpha, which is great for the maths part of my problems, but fairly often needs me to try several variants of my query because of the limitations of its natural language processing.
- scotty79 4y agoWolfram Alpha is just sophisticated calculator. I'm interested more in artificial mathematicians able to create novel conjectures and prove them.
- omnicognate 4y agoMy understanding is that relatively little success has been achieved in that direction. I'd love to be corrected if there's something I haven't learned of, but as far as I know no theorem of any significance has been independently originated and proven by a computer. Rather, computers are increasingly used to assist human mathematicians. Machine learning has recently been used to help with identifying and proving interesting theorems [1] but still very much as a tool for human mathematicians rather than an independent artificial mathematical "mind". Personally I think the ability to truly "do mathematics" may be a marker of AGI. If/when we have machines independently mapping out new and interesting areas of mathematics the way human mathematicians do I suspect we will have cracked meaning/understanding. FWIW I've felt that way for over thirty years and have never considered the Turing test a convincing marker of intelligence, so I don't consider myself to be moving goalposts when I find the (absolutely incredible) feats of the current generation of ML algorithms unconvincing as evidence that we're nearing AGI. [1] https://www.maths.ox.ac.uk/node/40529 https://www.maths.ox.ac.uk/node/40529
- kerakaali 4y ago> I asked GPT3 to teach me about addition and subtraction and it produced pure garbage in very lecturing tone. Sorry for laughing, but that's a rather funny thought to be given incorrect maths lesson via AI à la college professor. The field of AI-applied to mathematics is already somewhat developed actually! At the moment it's primarily done through proof assistants such as Coq[1], but there is work done to go further and apply ML to the field [2][3]. If you have any interest in the field, I would highly recommend you to take a dive and even play around with proving some simple theorems using Coq. This article[4] from Quanta is a good start to read a summary on the background and work up to now. [1] https://en.wikipedia.org/wiki/Coq https://en.wikipedia.org/wiki/Coq [2] https://resources.mpi-inf.mpg.de/departments/rg1/conferences/vtsa19/slides/Crzary-slides1.pdf https://resources.mpi-inf.mpg.de/departments/rg1/conferences... [3] https://arxiv.org/abs/2104.05207 https://arxiv.org/abs/2104.05207 [4] https://www.quantamagazine.org/how-close-are-computers-to-automating-mathematical-reasoning-20200827/ https://www.quantamagazine.org/how-close-are-computers-to-au...
- cs137 4y agoI'm convinced that everything Paul Graham has written since about 2009 is some generation of GPT. You could ask him if he's satisfied with its work. It's actually not hard to write a program that can do what he does. "What is wealth? Why are there unequal amounts of it? It's because wealth is what people want. If you can figure out what people want, you can generate a lot of wealth. Some people don't know this. Some people aren't cut out for startups. But people who know what people want can generate billion-dollar startups in record time by the standards of our ancestors. Unfortunately, there are people in politics and government who do not understand that wealth is what people want, and therefore cannot be regulated, because to do so is to regulate what people want, and companies that operate on this principle will find themselves unable to hire great programmers." This stuff isn't hard to generate... I did it by hand, stream of consciousness.
- imtringued 4y agoThere have been attempts to build neural turing machines and they do solve trivial problems like addition.