4 ms·
Wikipedia has a fine definition of what _emergent_ means: > In philosophy, systems theory, science, and art, emergence occurs when an entity is observed to hav
by xpe 4y ago
Wikipedia has a fine definition of what _emergent_ means:
> In philosophy, systems theory, science, and art, emergence occurs when an entity is observed to have properties its parts do not have on their own, properties or behaviors that emerge only when the parts interact in a wider whole.
The linked article uses this definition:
> we discuss the phenomena of emergent abilities, which we define as abilities that are not present in small models but are present in larger models
The concept in the paper has to do with capabilities / abilities that grow non-linearly as a function of model size. This is distinctly different from _emergent behavior_ in systems theory.
<opinion>The authors and reviewers could find a better word for their concept. There is no need to muddle the concept.</opinion>
Furthermore, the idea that networks of certain sizes are necessary for certain kinds of representational abilities is not new. Perhaps a term exists already?
- xpe 4y agoThis comment says it more eloquently than I did: https://news.ycombinator.com/item?id=34051845 https://news.ycombinator.com/item?id=34051845