6 ms·

Nothing about current AI models profoundly challenges the unknowns of what makes consciousness work in any mystery-resolving way. People who confuse plainly pro

Nothing about current AI models profoundly challenges the unknowns of what makes consciousness work in any mystery-resolving way. People who confuse plainly programmed algorithmic systems like GPT 4 or Midjourney with the still unresolved issues of sentience as we know it so far are drinking far too much of the current batch of AI punch. Sadly, it's a sentiment I see all too often on HN, a site in which i'd assume most readers and commentators would be a bit more skeptical-minded about these things. It's almost funny, considering how much hate this site tends to throw at things like crypto, to see so much of the wide-eyed opposite with the latest AI craze.

bangkoksbest 4y ago
Yeah, it reads so bizarrely to me... How are we confusing biological human (or other animal) sentience in some embodied creature with queries as a service to some model instance. I cannot see anything that remotely makes these two contexts architecturally, practically, or ethically similar, except in the narrow sense of query responses that might have been mistakenly thought of as defining sentience in earlier decades.
- disgruntledphd2 4y ago
  It's a function of the people who hang out here. If you like reading and text in general, you are both more likely to comment here and additionally regard language as the most important part of sentience/consciousness. This leads to believing that GPT has solved many of these issues.
  - FrustratedMonky 4y ago
    Maybe its degrees. Sure, GPT does not have a body, does not have all the senses. But that doesn't mean we aren't on the leading edge of developing a consciousness. Maybe next year someone will add camera visual inputs, and someone will add sound. Eventually, we'll have all the sense, and someone will put it in a body. So GPT, is rudimentary and we can still argue it isn't conscious, because when compared to a human that can run and play, it still has limitations. But it is amazing enough to start thinking those things will be possible. So why not discuss it, do you just want to dismiss it out of hand all the way until the end, what amazing thing would it take to have people admit it looks pretty lively.
    - galaxyLogic 4y ago
      I think everybody agrees it looks lively. And that discussion about it is good. That is why we ARE discussing it.
  - caddemon 4y ago
    As someone very language-focused, it has actually done the opposite for me: challenged some of my beliefs about how language enables intelligence. It's obviously skilled at language use, but most of its outputs where it has to make any sort of arguments or inferences read as incredibly stupid to me (even the ones that "tricked" people early on, some of them tricked me but in a way where I was about to write a response because I was annoyed at how bad the reasoning was). Of course that's not a criticism of the ML achievement, except that everyone and their mother has started making some extreme arguments about the thing.
    - jrsdav 4y ago
      Are you familiar with Pinker’s research presented in book The Language Instinct? > language enables intelligence In his research, he argues that it’s the other way around; we have an innate intelligence for acquiring language. To put it another way, language has made us more knowledgeable (because it’s a great mechanism for building and transferring context), but intelligence or aptitude for language was present before we developed languages. Does this align with how your views were reshaped post LLMs?
      - aastronaut 4y ago
        i think > language enables intelligence was just a poor choice of words here. i understood GP as "the structure of a language influences its speakers' worldview or cognition, and thus people's perceptions are relative to their spoken language"[0] [0]: https://en.wikipedia.org/wiki/Linguistic_relativity https://en.wikipedia.org/wiki/Linguistic_relativity
  - arolihas 4y ago
    There is a huge difference between a human saying they like ice cream and an LLM saying they like ice cream, but that seems to get completely disregarded in these types of discussions. Which leads to people making very wild declarations that we are close to AGI or solving consciousness.
    - loandbehold 4y ago
      What's the difference? Why is it significant?
- MrScruff 4y ago
  I think you're missing the point. It's not that GPT4 is sentient, not that successor LLMs will be. It may be we never create something that's sentient, by our definition. My argument is just that: - Sentience is variable. We might regard primitive organisms as biological machines. As some of these machines have slowly evolved to become more complex, sentience/consciousness has emerged, effectively by 'redesigning' and scaling the same hardware. It is an emergent property. At the same time this has been happening, other aspects of what we call intelligence have been developing. - Artificial networks being scaled, are also displaying emergent behaviours, some of which overlap with aspects of intelligence. This does not imply they are sentient, but it does strongly support some previous assumptions that sentience, like intelligence, is emergent and hence there will be no better answer coming.
  - fouc 4y ago
    There's no need to move goal posts. There's very clear definitions for sentience & sapience. The only confusion is that laypeople tend to conflate sentience & sapience. A sentient AI is not necessarily a sapient one, by definition.
    - galaxyLogic 4y ago
      Which definitions of "sentience" and "sapience" might you be referring to, in particular? This is important thanks for bringing it up.
FrustratedMonky 4y ago
That is pretty dismissive, do you have anything to back that up? Just saying one group is so out there it isn't worth arguing is typical when someone doesn't actually have an answer. I have found the opposite, the people that are dismissing that AI can be conscious or sentient, also don't have any definition for those terms. It's just the same "i think therefore i am" self viewpoint. I've found this typically with programmers that have never been introspective. Since they are familiar with programming, and GPT is programmed, thus obviously it can't be conscious, that's ridiculous. They don't take the time to try and understand where their own thoughts come from and then turn around and are dismissive that thoughts can be had by anything other than a carbon based animal.
- calimoro78 4y ago
  The burden of the proof that AI techniques of today can approach consciousness is on who believes they do, not the other way around.
  - FrustratedMonky 4y ago
    Maybe there is also some burden on other side to providing a definition of terms for the other party to argue against. I agree the burden of proof is on the AI side, but there is some burden on the deniers to provide some definitions if they wish to continue denying. AI Side: look here is my proof, Deniers: NO That isn't what I meant. I'd say GPT is already by its existence proof enough to start at least discussing consciousness. To dismiss it entirely because there is no proof, is just ignoring the proof.
    - galaxyLogic 4y ago
      > burden on other side to providing a definition of terms The skeptics are really not making any claims are they? If not then there's no burden of proof on them, is there? Whoever says or implies that ChatBots are or are "becoming" "sentient" are the ones making a claim. They should prove it if they make or imply such a claim. Skeptics are rightly skeptical, until they see a proof with clear definitions of terms from those who are saying or implying that ChatBots are 'approaching sentience".
MrScruff 4y ago
I think the mystery of why we're not just philosophical zombies was never going to have some eureka moment, given that it's quite plain it's an emergent property. Was there a creature in history that wasn't sentient that gave birth to a creature that was? Clearly not. The reason recent results are significant in this discussion is because: - Larger networks are already displaying emergent behaviours that couldn't have been predicted beforehand. It doesn't have to be 'human-like' intelligence for that to be significant. - We're getting close to a point where our models will start exhibiting something of the order of the same level of intelligence of primitive creatures. So the wide-eyed hysteria you're seeing is really just new data points confirming what many of us always assumed would be the case.
- Version467 4y ago
  > given that it's quite plain it's an emergent property. This explains nothing. Stating it's an emergent phenomenon gives us just as much information as saying it's magic. Arguably even less, because it sounds like an explanation, whereas "magic" doesn't pretend to explain anything. > displaying emergent behaviours that couldn't have been predicted beforehand. Same problem here. You say "couldn't have been predicted". Which is only true if you explain it away with emergence. The behaviours weren't predicted, because we don't understand how these networks work. Saying they couldn't have been predicted implies that we can't understand them. Which is a very bold statement and I'm fairly certain that it's not true.
  - MrScruff 4y ago
    > This explains nothing. Stating it's an emergent phenomenon gives us just as much information as saying it's magic. Arguably even less, because it sounds like an explanation, whereas "magic" doesn't pretend to explain anything. I don't think that's the case. Of course at one level we can understand how GPT4 works, we have a working implementation of it after all. But that doesn't help us predict how it will behave, because its properties are emergent, and have to be studied separately at that level. That's not saying it's magic.
  - pixl97 4y ago
    Some things will never be explained... for example what's the last digit of 22/7, and why out of all fractions around it that that particular number decides to extend towards infinity. Reality can be unsatisfying because it does not owe us explanations.
oldsecondhand 4y ago
Crypto has created no useful products yet, unlike AI. I don't know how can you even mention them on the same page.
elif 4y ago
Whether we are based on carbon or on silicon makes no fundamental difference; we should each be treated with appropriate respect.
- nradov 4y ago
  Why should I respect silicon? It's just a tool, like a screwdriver.
  - elif 4y ago
    you're arguing with Arthur C Clarke.
    - nradov 4y ago
      Why would I care what he thinks?
- Rufbdbskrufb473 4y ago
  Why? Isn't most ethical behavior driven by self-interest? We want to follow general principles that promote respecting those who are similar to us in the hope that others follow the same principles when interacting with us. AI is too dissimilar for us to worry about whether its "mistreatment" would make it more likely for others to start mistreating ourselves.
sanderjd 4y ago
HN was not always skeptical about crypto. We're just at a different point in the hype cycle with generative AI.
grantcas 4y ago
[dead]

bangkoksbest 4y ago

Yeah, it reads so bizarrely to me... How are we confusing biological human (or other animal) sentience in some embodied creature with queries as a service to some model instance. I cannot see anything that remotely makes these two contexts architecturally, practically, or ethically similar, except in the narrow sense of query responses that might have been mistakenly thought of as defining sentience in earlier decades.

disgruntledphd2 4y ago
It's a function of the people who hang out here. If you like reading and text in general, you are both more likely to comment here and additionally regard language as the most important part of sentience/consciousness. This leads to believing that GPT has solved many of these issues.
- FrustratedMonky 4y ago
  Maybe its degrees. Sure, GPT does not have a body, does not have all the senses. But that doesn't mean we aren't on the leading edge of developing a consciousness. Maybe next year someone will add camera visual inputs, and someone will add sound. Eventually, we'll have all the sense, and someone will put it in a body. So GPT, is rudimentary and we can still argue it isn't conscious, because when compared to a human that can run and play, it still has limitations. But it is amazing enough to start thinking those things will be possible. So why not discuss it, do you just want to dismiss it out of hand all the way until the end, what amazing thing would it take to have people admit it looks pretty lively.
  - galaxyLogic 4y ago
    I think everybody agrees it looks lively. And that discussion about it is good. That is why we ARE discussing it.
- caddemon 4y ago
  As someone very language-focused, it has actually done the opposite for me: challenged some of my beliefs about how language enables intelligence. It's obviously skilled at language use, but most of its outputs where it has to make any sort of arguments or inferences read as incredibly stupid to me (even the ones that "tricked" people early on, some of them tricked me but in a way where I was about to write a response because I was annoyed at how bad the reasoning was). Of course that's not a criticism of the ML achievement, except that everyone and their mother has started making some extreme arguments about the thing.
  - jrsdav 4y ago
    Are you familiar with Pinker’s research presented in book The Language Instinct? > language enables intelligence In his research, he argues that it’s the other way around; we have an innate intelligence for acquiring language. To put it another way, language has made us more knowledgeable (because it’s a great mechanism for building and transferring context), but intelligence or aptitude for language was present before we developed languages. Does this align with how your views were reshaped post LLMs?
    - aastronaut 4y ago
      i think > language enables intelligence was just a poor choice of words here. i understood GP as "the structure of a language influences its speakers' worldview or cognition, and thus people's perceptions are relative to their spoken language"[0] [0]: https://en.wikipedia.org/wiki/Linguistic_relativity https://en.wikipedia.org/wiki/Linguistic_relativity
- arolihas 4y ago
  There is a huge difference between a human saying they like ice cream and an LLM saying they like ice cream, but that seems to get completely disregarded in these types of discussions. Which leads to people making very wild declarations that we are close to AGI or solving consciousness.
  - loandbehold 4y ago
    What's the difference? Why is it significant?
MrScruff 4y ago
I think you're missing the point. It's not that GPT4 is sentient, not that successor LLMs will be. It may be we never create something that's sentient, by our definition. My argument is just that: - Sentience is variable. We might regard primitive organisms as biological machines. As some of these machines have slowly evolved to become more complex, sentience/consciousness has emerged, effectively by 'redesigning' and scaling the same hardware. It is an emergent property. At the same time this has been happening, other aspects of what we call intelligence have been developing. - Artificial networks being scaled, are also displaying emergent behaviours, some of which overlap with aspects of intelligence. This does not imply they are sentient, but it does strongly support some previous assumptions that sentience, like intelligence, is emergent and hence there will be no better answer coming.
- fouc 4y ago
  There's no need to move goal posts. There's very clear definitions for sentience & sapience. The only confusion is that laypeople tend to conflate sentience & sapience. A sentient AI is not necessarily a sapient one, by definition.
  - galaxyLogic 4y ago
    Which definitions of "sentience" and "sapience" might you be referring to, in particular? This is important thanks for bringing it up.

FrustratedMonky 4y ago

That is pretty dismissive, do you have anything to back that up? Just saying one group is so out there it isn't worth arguing is typical when someone doesn't actually have an answer. I have found the opposite, the people that are dismissing that AI can be conscious or sentient, also don't have any definition for those terms. It's just the same "i think therefore i am" self viewpoint. I've found this typically with programmers that have never been introspective. Since they are familiar with programming, and GPT is programmed, thus obviously it can't be conscious, that's ridiculous. They don't take the time to try and understand where their own thoughts come from and then turn around and are dismissive that thoughts can be had by anything other than a carbon based animal.

calimoro78 4y ago
The burden of the proof that AI techniques of today can approach consciousness is on who believes they do, not the other way around.
- FrustratedMonky 4y ago
  Maybe there is also some burden on other side to providing a definition of terms for the other party to argue against. I agree the burden of proof is on the AI side, but there is some burden on the deniers to provide some definitions if they wish to continue denying. AI Side: look here is my proof, Deniers: NO That isn't what I meant. I'd say GPT is already by its existence proof enough to start at least discussing consciousness. To dismiss it entirely because there is no proof, is just ignoring the proof.
  - galaxyLogic 4y ago
    > burden on other side to providing a definition of terms The skeptics are really not making any claims are they? If not then there's no burden of proof on them, is there? Whoever says or implies that ChatBots are or are "becoming" "sentient" are the ones making a claim. They should prove it if they make or imply such a claim. Skeptics are rightly skeptical, until they see a proof with clear definitions of terms from those who are saying or implying that ChatBots are 'approaching sentience".

MrScruff 4y ago

I think the mystery of why we're not just philosophical zombies was never going to have some eureka moment, given that it's quite plain it's an emergent property. Was there a creature in history that wasn't sentient that gave birth to a creature that was? Clearly not. The reason recent results are significant in this discussion is because: - Larger networks are already displaying emergent behaviours that couldn't have been predicted beforehand. It doesn't have to be 'human-like' intelligence for that to be significant. - We're getting close to a point where our models will start exhibiting something of the order of the same level of intelligence of primitive creatures. So the wide-eyed hysteria you're seeing is really just new data points confirming what many of us always assumed would be the case.

Version467 4y ago
> given that it's quite plain it's an emergent property. This explains nothing. Stating it's an emergent phenomenon gives us just as much information as saying it's magic. Arguably even less, because it sounds like an explanation, whereas "magic" doesn't pretend to explain anything. > displaying emergent behaviours that couldn't have been predicted beforehand. Same problem here. You say "couldn't have been predicted". Which is only true if you explain it away with emergence. The behaviours weren't predicted, because we don't understand how these networks work. Saying they couldn't have been predicted implies that we can't understand them. Which is a very bold statement and I'm fairly certain that it's not true.
- MrScruff 4y ago
  > This explains nothing. Stating it's an emergent phenomenon gives us just as much information as saying it's magic. Arguably even less, because it sounds like an explanation, whereas "magic" doesn't pretend to explain anything. I don't think that's the case. Of course at one level we can understand how GPT4 works, we have a working implementation of it after all. But that doesn't help us predict how it will behave, because its properties are emergent, and have to be studied separately at that level. That's not saying it's magic.
- pixl97 4y ago
  Some things will never be explained... for example what's the last digit of 22/7, and why out of all fractions around it that that particular number decides to extend towards infinity. Reality can be unsatisfying because it does not owe us explanations.

oldsecondhand 4y ago

Crypto has created no useful products yet, unlike AI. I don't know how can you even mention them on the same page.

elif 4y ago

Whether we are based on carbon or on silicon makes no fundamental difference; we should each be treated with appropriate respect.

nradov 4y ago
Why should I respect silicon? It's just a tool, like a screwdriver.
- elif 4y ago
  you're arguing with Arthur C Clarke.
  - nradov 4y ago
    Why would I care what he thinks?
Rufbdbskrufb473 4y ago
Why? Isn't most ethical behavior driven by self-interest? We want to follow general principles that promote respecting those who are similar to us in the hope that others follow the same principles when interacting with us. AI is too dissimilar for us to worry about whether its "mistreatment" would make it more likely for others to start mistreating ourselves.

sanderjd 4y ago

HN was not always skeptical about crypto. We're just at a different point in the hype cycle with generative AI.

grantcas 4y ago

[dead]