4 ms·
What is a domain? You talk of it like you know what it means. These things have no concept of a domain. If they use reasoning they use it all over the place. It
by SanderNL 4y ago
What is a domain? You talk of it like you know what it means. These things have no concept of a domain. If they use reasoning they use it all over the place. It is up to us to judge domainness.
- zarzavat 4y agoDomain as in a context, the type of data that they were trained on. Code vs text. English vs Russian. Python vs APL. For instance, OpenAI found that GPT4 is much better at reasoning in some human languages than others. It is best at reasoning in English, but struggles reasoning in less resourced languages. There is clearly some context-independent reasoning going on (i.e. generalization) otherwise the model would not be able to reason at all in languages that it hasn’t seen a particular problem in. But there also appears to be a large context-dependent factor.
- SanderNL 4y agoI see, very interesting.