3 ms·

Bad argument. My sense impressions consist of far more than just text input. We don't know if consciousness consists of one model, multiple models or is somethi

Bad argument. My sense impressions consist of far more than just text input. We don't know if consciousness consists of one model, multiple models or is something different from a statistical model but makes use of one or more of them. I also don't consist of only a nervous system, I also have an endocrine system that has very pronounced effects on my behaviour and my interpretation of input. There's a giant gap here that people keep glossing over when they treat LLMs as almost-human.

kybernetikos 4y ago
Sense impressions are mediated by fairly simple neuronal firing mechanisms, somewhat different, but similar in concept to the wires we use to encode language tokens. I'm not really trying to make a point here about consciousness, although I was interested by the article - it seems to imply that gpt-3 performs better at some tasks when it has a train of thought / stream of consciousness. People keep saying that there's a giant gap, but I still don't really know what they think it is, and there seem to be a lot of points of similarity. It's very clear that these large language models are, despite their problems, much more capable than was expected by nearly everyone not very many years ago.
- throwaway4aday 4y ago
  To me, it comes down to whether or not you think the sum total of a human being is language. If your life consists almost entirely of communication based activities then it's easy to see why one would think that is the case but if you spend any appreciable amount of time doing work that deals with physical objects and their interactions with the environment you find that language is only one tool in the box and isn't capable of replacing the others. That's not even bothering with the metaphysics of consciousness or subjective experience.
flangola7 4y ago
> Bad argument. My sense impressions consist of far more than just text input. Multimodal models are being trained right now using text images, video, and audio. Eventually you can add data from pressure, heat, and acceleration sensors and motors (sense of touch). We can further add additional "senses" - data from RADAR/LIDAR, magnetometer, multispectrum vision, radiation sensors if desired. AI will come to know our world very well.

kybernetikos 4y ago

Sense impressions are mediated by fairly simple neuronal firing mechanisms, somewhat different, but similar in concept to the wires we use to encode language tokens. I'm not really trying to make a point here about consciousness, although I was interested by the article - it seems to imply that gpt-3 performs better at some tasks when it has a train of thought / stream of consciousness. People keep saying that there's a giant gap, but I still don't really know what they think it is, and there seem to be a lot of points of similarity. It's very clear that these large language models are, despite their problems, much more capable than was expected by nearly everyone not very many years ago.

throwaway4aday 4y ago
To me, it comes down to whether or not you think the sum total of a human being is language. If your life consists almost entirely of communication based activities then it's easy to see why one would think that is the case but if you spend any appreciable amount of time doing work that deals with physical objects and their interactions with the environment you find that language is only one tool in the box and isn't capable of replacing the others. That's not even bothering with the metaphysics of consciousness or subjective experience.

flangola7 4y ago

> Bad argument. My sense impressions consist of far more than just text input. Multimodal models are being trained right now using text images, video, and audio. Eventually you can add data from pressure, heat, and acceleration sensors and motors (sense of touch). We can further add additional "senses" - data from RADAR/LIDAR, magnetometer, multispectrum vision, radiation sensors if desired. AI will come to know our world very well.