5 ms·
An example is where the link between the ideas is not present in the prompt. E.g. an oversimple example is: It’s going to rain tomorrow so you should take an
by svnt 2y ago
An example is where the link between the ideas is not present in the prompt.
E.g. an oversimple example is:
It’s going to rain tomorrow so you should take an umbrella.
If someone doesn’t understand the relationship between an umbrella and keeping dry — the implied premise — they won’t understand why they should bring one and the statement would be puzzling.
We talk about this often as someone or something “not knowing what an x is” where in this case “knowing” means in a spatial or logical sense, not just a linguistic sense.
LLMs do not have this layer of understanding but they can fake it in short interactions.
- deleted 2y ago[deleted]
- Sakos 2y agoOtherwise known as the idea of qualia (https://en.wikipedia.org/wiki/Qualia https://en.wikipedia.org/wiki/Qualia). There's no indication that LLMs possess anything like it, so there is no "knowing". I'm also not sure we can ever imbue an LLM with qualia without rethinking how we build LLMs and how they interact and learn from their environment.
- svnt 2y agoI think it is like qualia in the sense that it can be something known experientially, but spatial and logical reasoning are things that transcend subjectivity. No doubt LLMs do not have qualia as humans do, but I also think that the diversity of qualia present in humans is generally unqualified and underestimated at present.
- Sakos 2y agoYou can't have spatial and logical reasoning without qualia.
- svnt 2y agoI don’t know if that is true, unless your definition of qualia is so loose that it includes (or emerges from) basic data representations such as vectors comprised of weights and vertices, in which case I think LLMs could perhaps be argued to have basic qualia. There is often this attempt to draw a bright line on one feature or characteristic between humans and animals, or humans and AI, but I think that is a mistake based on an attempt to simplify the argument through reduction.