2 ms·
> So I'm seeing in your posts a pattern encoded (perhaps falsely) that makes me think that you think that what the text encodes is gospel. On the contrary. I t
by thomastjeffery 4y ago
> So I'm seeing in your posts a pattern encoded (perhaps falsely) that makes me think that you think that what the text encodes is gospel.
On the contrary. I think you have a pretty good description for how the behavior we want and the behavior we don't want exist as the same features. I am trying to restructure the narrative around LLMs to be about the patterns themselves, not what we hope the patterns to be.
We can throw around the word, "hallucinate", but that's just another anthropomorphization. Whether or not the pattern followed "makes sense" is a categorization humans attribute after the fact. GPT doesn't do "certainty". It does what it is given.
- AnimalMuppet 4y agoOK. I think I understand, and I think I agree. Thanks for the conversation.
- thomastjeffery 4y agoYou're welcome! I've been finding a certain satisfaction in trying to articulate this perspective. It's challenging because I'm criticizing most of the narrative that exists in the subject, but that narrative also gives a clear illustration of where to go wrong. I think better understanding the more mysterious patterns that exist in our writing might be really useful. Often, the first step in inventing something useful is to explore an unfamiliar domain and recognize what information we are missing.