3 ms·
Something often missed when talking about GAI is that we humans are built by our genes in order to facilitate their (not our) reproduction. Genes don't care ab
by lisper 9y ago
Something often missed when talking about GAI is that we humans are built by our genes in order to facilitate their (not our) reproduction. Genes don't care about anything, not even reproduction (except in the sense that water cares about flowing down hill), but one of the tricks they use to advance their "agenda" is to build brains that do care about things.
A lot of what we call "intelligence" is actually a side-effect of caring about things more than it is evidence of thinking. In particular, it's a side-effect of caring about the kinds of things that advance our reproductive fitness. For example: Hofstadter laments that, although computers can now trounce the best humans in chess, they don't look for "elegant moves" or decline to play and have tea instead. Hofstadter cares about these things because chess is more than an abstract mathematical construct. It is, like all sporting events, a social construct, one that distills the essence of competition where the participants care about who wins and who loses. And all of this derives from evolution where genes that build brains that care about winning competitions outperform genes that don't.
One of the things holding back computers from being GAIs is that we have not yet figured out how to make them care about anything, and so they cannot possibly understand the visceral difference between winning and losing, or the emotional angst of being up against a deadline or deciding to take a risk. All of these are part and parcel of everything we humans do. The ability to do math is just an interesting and useful side-effect, but it was never the main event.
Personally, I think it's a good thing that we don't know how to make computers care about things because once we figure that out they really will become potentially dangerous. Our desires are hard-wired into us by our genes. Once computers have desires of their own, their interests may align with ours, but that's not a given. And if they don't, that could be a really big problem.
- galaxyLogic 9y agoTrue, but it's good to keep in mind that genes don't have an "agenda" either. They just are the way they are because they survived. It's like having a neighbor who just won $100 million in lottery and thinking, vow, what is his secret? How could he do that? I don't think I could ever do that. How did he do it? The fact is he didn't have much to do with it, it was all pure chance.
- lisper 9y agoRight. That's the same point I was trying to make when I said that genes "care" about reproducing in the same way that water "cares" about flowing downhill. Neither genes nor water really care about anything, they just do what they do because physics.
- arketyp 9y agoUnsupervised and on-line learning has to be figured out first (perhaps by finally abandoning backprop methods, perhaps by finding some hybrid approaches); after that, I look forward to seeing veritable reinforcement learning and creature-like intelligences take shape. I've always been fascinated by how little is needed in terms of feedback loops in order for something to appear alive, I could say almost soul-like. The image in my mind is always that of -- and I'd like to give a better example -- the heat-seaking homing missile. I'm surprised Hofstadter, who is all about self-referential loopiness does not appreciate this, because I strongly agree with him in a belief that self-reference is the essence of much mystery. Then again, I never heard him passionately entertain chaos theory either, or psychedelics for that matter. I think Hofstadter has a very particular take on things (he calls himself a picky person). He can afford being obstinate because he is no doubt a free spirit and a brilliant guy, but it does make him appear dismissive sometimes.
- lisper 9y ago> I've always been fascinated by how little is needed in terms of feedback loops in order for something to appear alive You're not alone. https://en.wikipedia.org/wiki/Braitenberg_vehicle https://en.wikipedia.org/wiki/Braitenberg_vehicle