3 ms·

Yes, I’m also familiar with that Clarke quote. I do understand how these models work on a mechanical level, but we certainly have not unpacked all the emergent

Yes, I’m also familiar with that Clarke quote. I do understand how these models work on a mechanical level, but we certainly have not unpacked all the emergent behavior. What exactly is your evidence that there couldn’t be more going on? Once we have the ability to X-ray the black box and we only find simple conditional correlations behind an existential conversation, then I would agree with you, but we haven’t done that yet.

theGnuMe 4y ago
Read up on conditional probability.
- dougmwne 4y ago
  I already said it might be no more than conditional correlations. That does not account for an emergent combination of conditionals that could implement some undiscovered algorithms of sentience. If our brains are no more than computers and our own consciousness is software, then there exists some algorithm or combination of that gives rise to sentience. If these models arrived at this special algorithm during their training, much like the optimization of evolution arrived at the same, then we may have created something sentient. But the fact that our own sentience is a mystery means that there’s not a whole lot we can say mechanically about these LLM other than talk about their behavior and whether it’s convincing.
  - barking_biscuit 4y ago
    >If our brains are no more than computers and our own consciousness is software, then there exists some algorithm or combination of that gives rise to sentience. If these models arrived at this special algorithm during their training, much like the optimization of evolution arrived at the same, then we may have created something sentient. Joscha Bach gives a pretty good explanation of the algorithm we follow through the lens of Control Theory, and Stephen Wolfram has a pretty amazing Theory of Everything that explains how it can be arrived at. Joscha Bach: Nature of Reality, Dreams, and Consciousness https://www.youtube.com/watch?v=rIpUf-Vy2JA https://www.youtube.com/watch?v=rIpUf-Vy2JA Stephen Wolfram: Complexity and the Fabric of Reality https://www.youtube.com/watch?v=4-SGpEInX_c https://www.youtube.com/watch?v=4-SGpEInX_c
- barking_biscuit 4y ago
  But what about computational irreducibility that arises from complexity?

theGnuMe 4y ago

Read up on conditional probability.

dougmwne 4y ago
I already said it might be no more than conditional correlations. That does not account for an emergent combination of conditionals that could implement some undiscovered algorithms of sentience. If our brains are no more than computers and our own consciousness is software, then there exists some algorithm or combination of that gives rise to sentience. If these models arrived at this special algorithm during their training, much like the optimization of evolution arrived at the same, then we may have created something sentient. But the fact that our own sentience is a mystery means that there’s not a whole lot we can say mechanically about these LLM other than talk about their behavior and whether it’s convincing.
- barking_biscuit 4y ago
  >If our brains are no more than computers and our own consciousness is software, then there exists some algorithm or combination of that gives rise to sentience. If these models arrived at this special algorithm during their training, much like the optimization of evolution arrived at the same, then we may have created something sentient. Joscha Bach gives a pretty good explanation of the algorithm we follow through the lens of Control Theory, and Stephen Wolfram has a pretty amazing Theory of Everything that explains how it can be arrived at. Joscha Bach: Nature of Reality, Dreams, and Consciousness https://www.youtube.com/watch?v=rIpUf-Vy2JA https://www.youtube.com/watch?v=rIpUf-Vy2JA Stephen Wolfram: Complexity and the Fabric of Reality https://www.youtube.com/watch?v=4-SGpEInX_c https://www.youtube.com/watch?v=4-SGpEInX_c
barking_biscuit 4y ago
But what about computational irreducibility that arises from complexity?