3 ms·
It can reason but it has limited ability to transfer its reasoning skills into other domains. For example, it can take code and add types to it. This involves
by zarzavat 4y ago
It can reason but it has limited ability to transfer its reasoning skills into other domains.
For example, it can take code and add types to it. This involves a lot of reasoning ability. It can do this because it’s been trained on a vast amount of code. But it can’t yet fully transfer those reasoning abilities outside the narrow domain of code.
- SanderNL 4y agoWhat is a domain? You talk of it like you know what it means. These things have no concept of a domain. If they use reasoning they use it all over the place. It is up to us to judge domainness.
- zarzavat 4y agoDomain as in a context, the type of data that they were trained on. Code vs text. English vs Russian. Python vs APL. For instance, OpenAI found that GPT4 is much better at reasoning in some human languages than others. It is best at reasoning in English, but struggles reasoning in less resourced languages. There is clearly some context-independent reasoning going on (i.e. generalization) otherwise the model would not be able to reason at all in languages that it hasn’t seen a particular problem in. But there also appears to be a large context-dependent factor.
- SanderNL 4y agoI see, very interesting.