3 ms·
> One difference between humans and LLMs is that humans have a wide range of inputs and outputs beyond language. I share ability to move around and feel pain w
by killerstorm 4y ago
> One difference between humans and LLMs is that humans have a wide range of inputs and outputs beyond language.
I share ability to move around and feel pain with apes and cats.
What I'm interested about is ability "reason" - analyze, synthesize knowledge, formulate plans, etc.
And LLMs demonstrated those abilities.
As for movement and so on, please check PaLM-E and Gato. It's already done, it's boring.
> it's not because I'm predicting the words "I'm hungry". It's because I'm predicting that I'll be hungry.
The way LLM-based AI is implemented gives us an ability to separate the feeling part from the reasoning part. It's possible to integrate them into one acting entity, as was demonstrated in SayCan and PaLM-E. Does your understanding of the constituent parts make it inferior?
E.g. ancient people thought that emotions were processed in heart or stomach. Now that we know that emotions are processed mostly in the brain, are we less human?
- fauigerzigerk 4y ago>What I'm interested about is ability "reason" - analyze, synthesize knowledge, formulate plans, etc. And LLMs demonstrated those abilities. I disagree that they have demonstrated that. In my interactions with them, I have often found that they correct themselves when I push back, only to say something that logically implies exactly the same incorrect claim. They have no model of the subject they're talking about and therefore they don't understand when they are missing information that is required to draw the right conclusions. They are incapable of asking goal driven questions to fill those gaps. They can only mimic reasoning in areas where the sequence of reasoning steps has been verbalised many times over, such as with simple maths examples or logic puzzles that have been endlessly repeated online.
- danans 4y ago> I share ability to move around and feel pain with apes and cats. > What I'm interested about is ability "reason" - analyze, synthesize knowledge, formulate plans, etc. It's great that you are interested in that specific aspect. Many of us are. However, ignoring the far greater richness of human and animal existence doesn't give any more weight to the argument that humans are "just word predictors".
- Planktonne 4y ago> I share ability to move around and feel pain with apes and cats. You share the ability to predict words with LLMs. Something being able to do [a subset of things another thing can do] does not make them the same thing.