2 ms·
I think it's a matter of degree, not of kind. That is, the complexity of the model predicting the next token matters, and so does the space of possible tokens.
by TeMPOraL 4y ago
I think it's a matter of degree, not of kind. That is, the complexity of the model predicting the next token matters, and so does the space of possible tokens.
Ultimately, I think the definite answer would require solving the halting problem. The approximate answer we should be able to get when we let models interact with some complex environment over time. That is, the model predicts the next token, which may cause some change of a shared state, and then the model receives a response.
- maxbond 4y agoI dunno. Is there a testable prediction of this hypothesis? I just don't really see why I should believe it other than that chatting to LLMs is compelling, which isn't enough for me. This seems like an answer to the question, "why is the LLM so compelling?" And not "what makes something conscious/aware?" Which is an important question but feels like not quite the right one to ask and then come to this conclusion. And it bothers me if I try to accept an idea where I don't know what conditions I'd reject it (eg, I don't know what evidence would cause me to reject this hypothesis, I can't see a test I can perform to next reject it).