3 ms·
I'm only addressing a fraction of your many excellent points, but: this is actually why uncontrolled AGI is so spooky. It's the prospect of a future where space
by adamisom 4y ago
I'm only addressing a fraction of your many excellent points, but: this is actually why uncontrolled AGI is so spooky. It's the prospect of a future where space gets colonized-or whatever crazy goal(s)-but there's "nobody home", no qualia, no experiencer.
- BlueTemplar 4y agoThis assumes though that : - AGI is possible. - AGI is possible without recreating qualia / an experiencer in some form.
- jamiek88 4y agoHave you ever read Blindsight? It goes into the idea of intelligence without consciousness very well. Why should there be an experiencer? Is that necessary or even optimal for intelligence?
- BlueTemplar 4y agoWe really don't know ! (At least yet...)
- adamisom 4y agoWell, I hope it’s not possible !
- dbspin 4y agoThe original point stands even if AGI isn't possible in the strong sense. Self replicating embodied AI robots (in the contemporary machine learning / deep learning limited sense) may well be possible, and dangerous while being cognitively limited / affectively absent.