2 ms·
> here’s this assumption in and around the AI community that, as AI gets smarter, at some point, maybe the point of general AI—the point at which AI becomes as
by nl 3y ago
> here’s this assumption in and around the AI community that, as AI gets smarter, at some point, maybe the point of general AI—the point at which AI becomes as intelligent as a human being—suddenly the lights come on for the system, and it’s aware. It doesn’t just do things, it feels things.... There may be some forms of intelligence that require consciousness in humans and other animals. But fundamentally they’re different things. This assumption that consciousness just comes along for the ride is mistaken.
Yes.
And yet the pseudo-scientific game theory analysis of Yudkowsky etc never even contemplates this (as well as so many other possibilities outside their toy analysis). It remains astonishing to me that anyone takes them seriously.
- simonh 3y agoI think for consciousness you need a sophisticated mental model of the world, but also a sophisticated mental model of other intentional agents and their mental processes. You need to be able to reason about the knowledge, beliefs and likely actions of others. When this is generalised to enable modelling and reasoning about our own knowledge, beliefs and intentions, that’s consciousness. We literally become aware of ourselves, our intentions and thought processes recursively in ways we can reason about. So consciousness is a process, an activity. It’s a thing we sometimes do. I actually don’t think most living things, even animals, are conscious. Mammals and some other higher animals possibly. Simple organisms have simple sense/response nervous systems. Their reactions are mostly automatic, but can learn basic patterns of stimuli.
- grantcas 3y ago[dupe]