4 ms·
"it is comparatively easy to make computers exhibit adult level performance on intelligence tests" Is this even remotely close to being true? I'm not aware of
by TheOtherHobbes 7y ago
"it is comparatively easy to make computers exhibit adult level performance on intelligence tests"
Is this even remotely close to being true? I'm not aware of any AI projects that can match an average human score on a standardised IQ test.
In fact I'm not aware of any AI projects that can understand how an IQ test paper works without prior coaching.
Most humans won't just attempt the problems but will be able to work out what the questions are asking, even if they have never seen those kinds of questions before.
So this seems wholly wrong to me. I don't disagree that basic motor skills and perceptions are an important and difficult part of the puzzle, but I absolutely disagree that abstract thinking is a comparatively trivial solved problem - or that board game solvers are anything other than a warm-up exercise.
- goatlover 7y agoThat's a problem I have with the paradox. While it's true for some high level cognitive skills, it's not true in general. The general purpose AI has proven to be as hard or harder than the sensory-motor skills. Otherwise, we would have HAL-like computers.
- mannykannot 7y agoIndeed. At the time the paradox was proposed, there had not been much progress in natural language understanding, so the scope of what it considers to be AI has at least one important part missing.
- Retric 7y agoLanguage is a low level task. You don’t think about decoding “purple” or associating it with a color that’s automatic. Similarly decoding letter shapes etc. Even forming responses is very automatic. You yell “Stop” you don’t think what’s the best phrase to convey they are about to hit a car. Though like breathing you can pay attention and do something else.
- mannykannot 7y agoTo the contrary, of all the cognitive capabilities that evolution has bestowed on us, I think language is clearly the highest.
- Retric 7y agoDefining your own scale is fine. But, don’t be confused when you are the only one using it. High vs low level tasks are defined in terms of what you can do while doing the task. You can be thinking about a math problem for example while talking with someone.
- mannykannot 7y agoI will agree that tasks like parsing sounds and forming words are low-level tasks, but my original post was about understanding the meaning of language, and it is not just in my own private lexicon that this is regarded as a higher cognitive process, as a brief search will reveal (e.g. [1].) With regard to your ranking test, is it talking with someone or thinking about a math problem that gets ranked as low-level? It would seem to work either way, in which case, I guess it would be both. [1] https://www.thefreedictionary.com/higher+cognitive+process https://www.thefreedictionary.com/higher+cognitive+process
- Retric 7y agoMedicine, psychology, and neuroscience all have different definitions of this stuff. understanding the meaning of language Understanding is vague in these terms. You can notice someone calling your name while distracted with other activities. That’s an automatic process and assigning meaning for each word in English is a difficult task. How do you teach a computer what cells are in the abstract? There is also some high level language decoding where people extract meaning from poetry etc. But, we need to get the low level task done first. PS: As to ranking, their are a lot of high level tasks you can’t do at the same time. Often described as things that take concentration, but few language tasks make this list.
- deleted 7y ago[deleted]
- scottlocklin 7y agoPut it in historical context; the mainframes of Moravec's day were less powerful than a microcontroller which controls the windshield wiper in your car. The fact that guys like Moravec were able to build checkers computers, things that could "talk" (at least in the meta-x emacs sense), things that could diagnose infectious diseases as well as a doctor, and things which did applied mathematics (those integrals didn't integrate themselves back in the day) is absolutely astounding. The fact that they we still can't generally solve crap like the lost robot problem which insects are able to handle should also strike you as astounding. That's what the Moravec paradox means. Stuff humans find difficult due to logic, abstraction and theory are often easy for computers, and stuff that bugs can do naturally are still impossible for computers.
- lidHanteyk 7y agoThese projects exist, and are so easy that we don't even bother to use AI on them. As an example of high-level reasoning, Metamath has a body of theorems of ZFC using classical logic [0]. This body of theorems is written out using entirely formal (symbolic, syntactic) reasoning. Over 32,000 theorems are checked in total, at a rate of around 6 kilotheorems per second. If we recall that proof search is (Turing-)undecidable, for the systems that we care about, then it becomes unsurprising that we do not put AI to the task, other than as a light at the end of the tunnel, since proof search is not only AI-hard, but as impossible for AIs as for humans. That said, there have been constant improvements to the automated generation of human-readable proofs, and the papers have the same shape as AI research papers from previous generations of AI, with expert systems and inference engines [2][3]. Your focus on IQ tests is a little unhealthy [1]. [0] http://us.metamath.org/mpeuni/mmset.html http://us.metamath.org/mpeuni/mmset.html [1] https://en.wikipedia.org/wiki/Intelligence_quotient#History https://en.wikipedia.org/wiki/Intelligence_quotient#History [2] https://www.ijcai.org/Proceedings/15/Papers/172.pdf https://www.ijcai.org/Proceedings/15/Papers/172.pdf [3] http://poincare.matf.bg.ac.rs/~janicic/papers/2014-amai-aftarski.pdf http://poincare.matf.bg.ac.rs/~janicic/papers/2014-amai-afta...
- thechao 7y agoThe SI unit for “theorem / second” is the Erdos.
- Sharlin 7y agoA standard RPM[1] test should to be a fairly simple problem for a good old-fashioned reasoning system to solve if you first remove the sensorymotor aspects of it! That is, you have to translate the test to a purely logical representation, otherwise what you have is just an instance of Moravec's paradox. [1] https://en.m.wikipedia.org/wiki/Raven%27s_Progressive_Matrices https://en.m.wikipedia.org/wiki/Raven%27s_Progressive_Matric...
- deleted 7y ago[deleted]
- mobjack 7y agoThe point is that you could train AI to perform well at IQ tests but it doesn't mean that it demonstrated actual intelligence.
- rossdavidh 7y agoI think it is true if you put proper emphasis on the word "comparatively". It's maybe better to state it as "It is much harder to make computers control movement as well as a toddler, than it is to make them exhibit adult level performance on intelligence tests." Or, to put it another way, the hardest part about teaching a computer to do a classical IQ test is how to hold the pencil, not how to find the right answers.
- tabtab 7y agoI believe where test-taker bots fail is if the question assumes human experience or "common sense". If the question starts out, "If you eat half of an apple...", the bot won't naturally understand "eat" in terms of what it does to an apple. It has to be programmed with some kind of model or heuristics for eating ahead of time.