3 ms·
"It simply does not outside of the realm of science fiction." If you could prove that, you'd put a lot of minds at ease. By "prove" I mean not necessarily a fu
by jerf 11y ago
"It simply does not outside of the realm of science fiction."
If you could prove that, you'd put a lot of minds at ease. By "prove" I mean not necessarily a full mathematical proof, but certainly more than a few paragraphs of English text.
I'm skeptical myself, seems like the more we learn about biology the more it is doing that we did not realize, but skepticism is at best the first step to proof.
- andreyf 11y agoI think it will be obvious once HGI is sufficiently understood, in a way that will not need more than a paragraph, if that. The fear and idea of somehow creating an HGI without understanding how to control it came from The Terminator. It's pure fantasy.
- robertk 11y agoFactually disputed. The concerns raised in this area originated in the 90s, conceived prior to release of the first Terminator film.
- andreyf 11y agoThe first Terminator was released in 1984. The idea existed before it, of course.
- eli_gottlieb 11y agoJust because we will understand, in principle, how to control it, doesn't mean we'll engineer that control particularly well.
- jerf 11y agoThat doesn't even rise to the level of proof-by-disbelief; it's proof by hypothetical future disbelief. You've given no more reason to be confident in your hypothetical than the concerns about hypothetical self-improving AIs. You're failing to sell this argument to someone generally inclined to agree with you about the outcome.
- andreyf 11y agoWhat is proof-by-disbelief? I'm not trying to prove that HGI is impossible, nor do I think it's impossible. However, until one proposes a concrete methodology for modeling the world which includes the method that is doing the modeling (self-awareness), a decision making process, and a way to take action autonomously and without intervention, it's very hard to talk generally about preventing catastrophic bugs.