2 ms·
> In Emergent abilities of large language models, we defined an emergent ability as an ability that is “not present in small models but is present in large mode
by amelius 4y ago
> In Emergent abilities of large language models, we defined an emergent ability as an ability that is “not present in small models but is present in large models.”
Shouldn't it be defined as the ability of an LLM to do stuff that it was not explicitly trained to do (i.e. not a direct reproduction of what is in the training data)?