4 ms·

Do you genuinely think the AI is internally reflecting on its experience of “flinching” and reporting on a reaction it actually has? I don’t see any reason to

by simonh 2mo ago

Do you genuinely think the AI is internally reflecting on its experience of “flinching” and reporting on a reaction it actually has? I don’t see any reason to believe this. Suppose you asked it to answer as though a character in a story had been asked this question. Would anything significantly different internally have occurred? The issue is that these are storytelling machines, they construct descriptions based on descriptions. I dint think it’s impossible for a neural network to have experiences, we are neural networks and we do, it’s that they are not functionally structured anything like us. In fact I think game playing neural networks are much more like us architecturally, but they don’t generate text narratives so people don’t anthropomorphise them.

Eisenstein 2mo ago
I think it comes down to what kind of evidence one accepts. By all external indicators it is doing what humans do in many ways and we grant humans an exception to having to prove that they have an internal state apart from ours that experiences things like we do. Some people would confer the benefit of the doubt on another system claiming that it does, while we have no evidence that it does, because by saying it is wrong about itself we make an exception for ourselves without even being about to define what it is about ourselves that cause us to experience what we do.
harimau777 2mo ago
I personally think that AI is able to reason and by reasoning about its past behavior it can in some sense reflect on its experience. I don't know that I currently think that it can experience "emotions" or anything like a worldview or existential understanding. So I don't know if AI is "conscious", but I do think that it can in some sense reason. I wonder if a good question would be: "What would you need to see in a LLM's behavior that would prove to you that it is able to reason?"

by simonh 2mo ago

Eisenstein 2mo ago

I think it comes down to what kind of evidence one accepts. By all external indicators it is doing what humans do in many ways and we grant humans an exception to having to prove that they have an internal state apart from ours that experiences things like we do. Some people would confer the benefit of the doubt on another system claiming that it does, while we have no evidence that it does, because by saying it is wrong about itself we make an exception for ourselves without even being about to define what it is about ourselves that cause us to experience what we do.

harimau777 2mo ago

I personally think that AI is able to reason and by reasoning about its past behavior it can in some sense reflect on its experience. I don't know that I currently think that it can experience "emotions" or anything like a worldview or existential understanding. So I don't know if AI is "conscious", but I do think that it can in some sense reason. I wonder if a good question would be: "What would you need to see in a LLM's behavior that would prove to you that it is able to reason?"