4 ms·
Except we do that for humans and it's still not really relevant to language models. If I were talking to a python programmer I could assume they knew what a fo
by Xelynega 4y ago
Except we do that for humans and it's still not really relevant to language models.
If I were talking to a python programmer I could assume they knew what a for loop was, so could phrase a question requiring the context of one differently than I would for the layperson. Just like if I were designing inputs to one language model I could assume it's capabilities that are different from another.
I don't think it's relevant to the performance of language models for that same reason though, we already have to design out queries with the thing being queried in mind so I don't see why we wouldn't for llms.