4 ms·
I think sentience/consciousness are relatively clear concepts, at least in most areas of application (there are serious problems at the edges - e.g. is a an ins
by tsimionescu 4y ago
I think sentience/consciousness are relatively clear concepts, at least in most areas of application (there are serious problems at the edges - e.g. is a an insect conscious? if you think it is, how about a jelly fish? if that too, how about a bacterium? a virus?).
However, our understanding of this concept is too limited to create a formal model that we can define satisfactorily; and coming up with an arbitrary model that fits some of our intuitions is silly. This is what the Integrated Information Theory people did, and I find it closer to economic models than to actual science - a nice little abstraction that can give you the appearance of being rigorous while in fact speculating wildly.
On the other hand, I think it's fair to say there are some decently well understood must-haves for something to match our idea of sentience - and being aware of yourself in the world is one of them; and yes, in that sense, it makes more sense to talk about the robot arm as being sentient, as simple as it is, than it is to say that about LaMDA or GPT-3. Of course, the robot arm is missing other per-requisites for sentience - it's programming is far too rigid, and it has no introspection.
- rendall 4y ago> I think sentience/consciousness are relatively clear concepts Not at all! When we say conscious, do we mean awake or self-aware or recognizes self in mirror or something else? When we say sentient do we mean feels or intelligent or trapped in the wheel of reincarnation and suffering or something else? When we say intelligent, do we mean completes tasks or uses language or...?
- tsimionescu 4y agoThe fact that the word "conscious" is a synonym for several concepts is entirely irrelevant to this conversation. The concept that we can't yet capture formally is the kind of sentience that living, awake humans surely have, most animals probably have, and rocks definitely don't have. The limits of this are harder to pin down, as, again, we lack a deep formal understanding. But we do know exactly what we'd like to formally model.
- rendall 4y ago> "But we do know exactly what we'd like to formally model" Do we really? I thought it was a deeply intractable problem for cognitive theorists and other such experts. Haven't you ever encountered a challenge that you at first thought was straight-forward and obvious to solve, but after digging in find it was unexpectedly nuanced and difficult? > "The limits of this are harder to pin down, as, again, we lack a deep formal understanding." Doesn't that contradict? If you were to try pinning down precisely what you mean by "the kind of sentience that living, awake humans surely have, most animals probably have, and rocks definitely don't have", I suspect it will not be nearly as easy as you think. How do you know rocks don't have it, for instance? How do you know you do, for that matter?
- tsimionescu 4y ago> How do you know rocks don't have it, for instance? How do you know you do, for that matter? These are both part of the (incomplete) definition I gave you. There have been problems like this before in the history of science - we have concepts that we intuitively understand, and want to give a formal definition for. This can take a long time of careful study - such as coming up with a complete definition for "insect". Other times it can indeed turn out that the concept was ill-defined - there is no possible formal definition for the concept "fish" that doesn't appeal to the human mind (the various organisms we think of as fish are too diverse genetically to find a satisfactory one-to-one mapping with any group of animals, even if you exclude a small set of them, like the aquatic mammals).
- rendall 4y agoOk. I'm responding to the statement that these are "relatively clear concepts". AI will by definition never have "the kind of sentience that living, awake humans have" (and I do acknowledge that this is only a working definition) because the goalposts will continue to move according to whim in the absence of a more formal definition. I remember when one prevailing formal test of self-awareness was "independently claiming to have self-awareness". There were caveats, of course, but that goalpost has evidently moved.
- perlgeek 4y ago> I think sentience/consciousness are relatively clear concepts, at least in most areas of application If you think that, try to come up with a black-box test that determine if something or someone is sentient / conscious. I think that it is pretty clear to US that WE are sentient, and it's pretty clear to us that block of silicon isn't sentient, because it's so different from us, and because it doesn't make a sad face when we're mean to it -- but that assumes that our form of sentience is the only one that counts. The article quotes a tweet saying > It is mystical to hope for awareness, understanding, common sense, from symbols and data processing using parametric functions in higher dimensions. but that is all our brains do, really. How can we claim that a computer doing the same kinds of computations that we do is fundamentally different? This just reeks of human exceptionalism.
- tsimionescu 4y ago> If you think that, try to come up with a black-box test that determine if something or someone is sentient / conscious. As I said, we don't understand such things at a deep enough level to come up with formal models of them. But we do know what it is that we'd want to model. We do know for sure that humans and other mammals are sentient, while rocks are not. I also can't generate a black box test that will predict whether something is porn, but that doesn't mean I don't understand what porn is, or that it is some deep mystery.
- XorNot 4y ago> but that doesn't mean I don't understand what porn is You only understand what it is for you. The history of complete failures with regard to obscenity laws makes it quite clear though that this is not sufficiently common to produce satisfactory definitions at a societal level. You are mistaking the overlap of opinion you share within your social cohort with some sort of objective, species wide truth.
- mikkergp 4y agoKnowing that gravity is much more complex than “the thing that causes an apple to fall to the earth” doesn’t not make gravity the thing that causes an apple to fall to the earth.
- tidenly 4y agoThe problem is that lots of people who have never done any introspection, or looked into the discussions in the field of artificial sentience, will draw completely arbitrary lines in the sand for what "cannot be sentient". I took issue with the article saying sentience requires an "awareness of the world" too. I think it self-evident that a humans sentience doesn't disappear when we remove sensors like sight, or touch, or sound - it just means their experienced world is different from the world. In the end, I only really feel confident saying sentience requires probably some perception, and information processing. A sense of self also feels right, like it should be necessary, to me - but again depending on what senses we give to a thinking entity, its reasonable it may not have enough sensory information to create a concept of self vs other, while still being able to process information intelligently, ""think"" and learn. There are lots of other arguments above saying Lambda can't be sentient because it doesn't experience human emotions, fear, self-presevation, and doesn't run until prompted. However I think those are again all sensory choices and implementation details, which avoid the actual question of what sentience as an emergent behaviour is, and how we could ever detect it. These are age-old questions experts in the field still argue about, it's sad to me how over-confidently a lot of the above repliers are in their lack of consideration to the problem at hand.