4 ms·
How about this instead: Current AI technologies give us no insight about the probability of an AGI Because that is exactly the point. We can't look at what we
by AndrewKemendo 12y ago
How about this instead:
Current AI technologies give us no insight about the probability of an AGI
Because that is exactly the point. We can't look at what we have built today and extrapolate that AGI will come from it.
All anyone can do is speculate wildly on AGI just as they were able to in 1956 [1]. The difference is that we see automation/computing as ubiquitous (smartphones/computers in 2015), rather than around the edges (Radio/TV 1956). Which brings it closer to home in some ways.
[1] I chose 1956 because of the dartmouth conference on AI
- aamar 12y agoWell, yes, but that's still a straw man. It's not as if Hawking and Gates and so on saw an Atari-bot and on that basis came to worry about AGI. Current AI technologies shouldn't update our estimates much about AGI, unless they push us way off of Kurzweil's (or someone else's) chart. I do agree that we lack evidence of a broad community of AI experts who have been able to make good predictions, which potentially puts AI research even behind economists! Nonetheless, we'd expect there to be a period between "wild guessing" and "good and reliable models"; Gates and Hawking either think we're in that middle ground, or they think the risks are considerable enough that it's worth pushing towards it now.
- AndrewKemendo 12y agoOr the third option: they want to get in on the AI buzz that is happening.
- csallen 12y agoI think that in any debate, you have a responsibility to respond to the strongest version of the opposing argument. Even if your "third option" is correct and the specific aforementioned people just "want to get in on the AI buzz", that still doesn't justify ignoring the argument itself.
- waterlesscloud 12y agoBecause Hawking, Gates, and Musk needed more buzz? Whatever buzz AI has is nothing compared to what these guys have had for years.
- cousin_it 12y agoProbability of AGI is close to 100%, conditional on mankind surviving long enough. We know that human brains don't run on magic, therefore you can build a machine that can do the same thing. (Turing computability doesn't matter, if the brain relies on non-Turing-computable physical effects then a machine can rely on those as well.) The current situation where unmodified humans are the smartest creatures around is unstable in the long term. Saying that we don't have to worry because AI development will take 1000 years is also missing the point. Research into unsafe AI is inherently faster than research into safe AI, because the latter problem is more constrained. If unsafe AI kills us all, the best time to start working on safe AI is 100 years ago, and the second best time is now. Saying that we don't have to worry because smarter than human intelligences will have a better understanding of morality is also missing the point. All currently known mathematical formalisms for decision-making allow you to plug in arbitrary utility functions, including "immoral" ones. Thinking that future decision-making formalisms will support only "moral" utility functions is extreme wishful thinking. Saying that we don't have to worry because brain emulations or human cognitive enhancement will come first is also missing the point. These things can be just as dangerous as AI (e.g. see Robin Hanson's descriptions of how mind uploading increases Darwinian pressures on everyone, including non-uploaded people), and can also lead to AI more quickly. And so on. If you want to feel safe and protected, no one can stop you. But you don't have any good arguments for feeling safe. I'm sorry, but you really don't. I've been on the lookout for such arguments for years, and I'd be happier if they existed.
- AndrewKemendo 12y agoWe know that human brains don't run on magic, therefore you can build a machine that can do the same thing. I mean that is what I think, and most of the community thinks, but we haven't proven that empirically - nor could we, its unprovable. But you don't have any good arguments for feeling safe. Correct. Notice that I am not saying that we are safe. I personally think we aren't safe [1], but that is a different discussion which is equally as baseless. The key here is that the argument that AGI will not be safe, and therefore needs to be regulated to make it safe, not only misses the point but ensures that we would never make one. The current level of funding for AGI development and understanding of the roadmap for AGI is absolutely dismal given it's potential impact. If we now add the constraint that in order to make one, we also ensure it doesn't threaten humanity - then you have sounded the death knell for AGI. Once we make AGI - in the sense that it is a recursively self improving system with human equivalent capabilities across domains - there is no way we will know what will happen. That's it. [1] Which is why I am personally in the transhumanist camp.