3 ms·
That's the definition that matters. And as it's impossible to describe in words what it's like to experience qualia, and LLMs are trained on words, they canno
by DonaldFisk 23d ago
That's the definition that matters. And as it's impossible to describe in words what it's like to experience qualia, and LLMs are trained on words, they cannot know what it's like. Even if images and sounds are included in their input training data, those are just arrays or sequences of numbers, not the experience of seeing and hearing.
- jstanley 23d agoTheir training data isn't qualia itself, but neither is your training data. Qualia are something you get on the inside in response to inputs. I don't see why LLMs can't have them. I'm not saying they do, but I don't think your argument proves that they don't.
- DonaldFisk 23d agoMy training data on qualia is actually seeing, hearing, and otherwise sensing things, not just reading about them.
- fc417fc802 23d agoAh yes, because you used the magical pixie dust that makes experiences "real" therefore you're actually seeing and hearing while a multimodal LLM doesn't really experience what it sees and hears "for real". We can be certain of this because, despite not being able to quantify or even rigorously define the phenomenon we intentionally deprive the LLMs of access to said magical pixie dust.
- t_von_doom 23d agoI agree. To further ask, why is your training data objectively real and qualifies you for consciousness? Is a deaf or blind person not conscious because they don't share your training data? If a deaf person reads about sounds, their experience of them is moot? If an alien with a greater array of senses then us exists, are we therefore not conscious?
- DonaldFisk 23d agoPeople aren't just consciousness, they're conscious of things. Of course a deaf or blind person is conscious, even if they've been deaf or blind since birth. But they aren't conscious of hearing or seeing things, and if you ask them they'll tell you that. I'm not conscious of magnetic fields, or ultraviolet light, but other animals are, and no amount of study will overcome that deficit.
- fc417fc802 23d agoOkay, but there are multi-modal models. So do those experience qualia of sound and images? Do the text based ones experience the qualia of reading, or of finally comprehending a difficult concept after struggling with it? For that matter, what exactly is the difference between "seeing" that a car is red versus an LLM reading an array of pixel data? Your eyes "just" translate photons into analog signals after all.
- DonaldFisk 23d agoI've already answered this. There's no way someone deaf from birth could know what it's like to hear sounds, by looking at the pixels in a sound recording they know the format of, and if you don't believe me you can ask them. Or by looking at a speech spectrogram (which, with practice, are more easily readable). Or you can ask yourself what ultraviolet looks like, or what it's like to sense a magnetic field. Lots of animals can do these, and would know what it's like, but people can't.
- fc417fc802 23d agoNo, you have not answered. I asked you what you believe the difference is between the two phenomena in concrete terms. What you've done is beg the question. > There's no way someone deaf from birth could know what it's like to hear sounds, by looking at the pixels in a sound recording they know the format of On what basis could you possibly make this claim? What does it mean to hear? You're taking in information and decoding it, right? So what magical pixie dust could your eardrum possibly be applying that specially privileges that particular mode of input? How is an LLM "reading" pixel data fundamentally different from your eyes transforming it into an analog signal? Please be specific about the mechanism.
- DonaldFisk 23d agoI just explained this. If someone looks at the contents of an image file without displaying it, they don't experience the colours either. So how can LLMs experience them?
- fc417fc802 23d agoRight. Because your eyes ... imbue the magical pixie dust ... no wait, is it your visual cortex that does it? Hmm ... Less facetiously, I'm unclear where you believe this magic "qualia" thing to be happening and what you believe the (meta?)physical mechanism to be.
- DonaldFisk 23d agoQuite a lot has been published about neural correlates of consciousness, so I'll go with whatever the evidence suggests. There are literally hundreds of attempted explanations of phenomenal consciousness, none of which is generally accepted. For what it's worth, I think it's fundamental, i.e. not an emergent property of matter. At the very minimum, I think to be conscious of anything (other than nothing) requires the ability to sense the physical environment. What's your position?
- fc417fc802 23d ago> For what it's worth, I think it's fundamental, i.e. not an emergent property of matter. > requires the ability to sense the physical environment Aren't those two statements at odds? Your synapses are made of matter, so sensing the physical environment is being done by matter. You are fundamentally matter (AFAIK). To suggest otherwise the only thing that comes to mind is substance dualism. My position is that we don't know. I know I'm conscious. I assume other humans are simply because they're approximately the same as me and were produced by the same process. The farther you get from humans the less certain I am. Many insects resemble biological automatons if you examine them closely. Certainly single celled organisms don't seem likely to have anything going on. If you figure that a clod of dirt can't possibly be conscious but a mouse is, what's the relevant physical difference? Electricity? Computers have that. Complexity? Information density? Both of those as well. What do you think it means to sense?