3 ms·
I'm not sure what you would call it, but is there any research into the dilemma that exists when an artificial intelligence surpasses its creator? How exactly w
by endisneigh 6y ago
I'm not sure what you would call it, but is there any research into the dilemma that exists when an artificial intelligence surpasses its creator? How exactly would we evaluate its decisions?
I'm not suggesting this example is the case, but with AlphaZero, for example many of the moves are beyond an average players comprehension. What happens when it's beyond the greatest of us?
Exciting times are ahead!
- nl 6y agoYes there is research in this area. It's controversial because most practising researches in the field of building AI don't believe it is a concern on any close timescales. https://theconversation.com/singularity-how-governments-can-halt-the-rise-of-unfriendly-unstoppable-super-ai-121999 https://theconversation.com/singularity-how-governments-can-... provides some starting points.
- endisneigh 6y ago> It's controversial because most practising researches in the field of building AI don't believe it is a concern on any close timescales. I'd agree with that, but I wouldn't be surprised if some narrow domains are completely surpassed.
- nl 6y agoOh absolutely. It's increasingly hard to find benchmarks where humans aren't beaten (outside Francois Chollet's work).
- Veedrac 6y agoNote that a very significant fraction do believe human level machine intelligence is likely within about 50 years, and a good few on closer timescales, though the precise numbers are endlessly debatable. Two major AI corporations, DeepMind and OpenAI, are explicitly aiming to create AGI. https://arxiv.org/abs/1705.08807 https://arxiv.org/abs/1705.08807, https://www.youtube.com/watch?v=HOJ1NVtlnyQ https://www.youtube.com/watch?v=HOJ1NVtlnyQ
- astrange 6y agoAlthough ML has definitely developed something, it has nothing to do with AGI, so they don't seem anywhere close. Instead it seems like we've gotten good at inventing visual cortexes. AGI would involve having some motivation to stay alive, affect the world and imagine things, instead of just using a fixed amount of CPU to point out whether something looks like a cat. From the article: > Unlike humans, CLIP can’t slow down to compensate for the harder task. Instead of taking a longer amount of time for the incongruent stimuli, it has a very high error rate.
- Veedrac 6y agoI like to keep personal opinions out of statistical data about opinions, since they are very different qualities of argument. Any individual take doesn't meaningfully affect the distribution of opinions. The key is that there is no argument from consensus to be made; smart people disagree, AGI within our lifetimes is not a niche expectation. Anyhow, I suspect you're not familiar with ML research, since eg. there are plenty of non-feedforward networks available. I also don't think much of this really matters; it is absurdly anthropocentric to expect ‘motivation to stay alive’ to be fundamental to intelligence.
- nl 6y agoName an actual active ML researcher who believes human level AGI is likely within our lifetime. Good researchers will never rule it out of course but I don't know any who think it is likely (I work in the field).
- Veedrac 6y agoDemis Hassabis. https://www.youtube.com/watch?v=h0962biiZa4 https://www.youtube.com/watch?v=h0962biiZa4, older https://www.youtube.com/watch?v=Qgd3OK5DZWI https://www.youtube.com/watch?v=Qgd3OK5DZWI (NB ‘likely’ ≠ ‘>50%’, not sure what his percentage would be) I can give more but I did upstream link to a paper on this so it seems pretty pointless.