3 ms·

Just "abilities present in large models not present in small models". This also makes clear its relative nature (that is, what "large" and "small" mean), which

• 1123581321 4y ago
  That’s much longer and raises more questions (what is large and small, does this gradually or discretely appear.)
• LawTalkingGuy 4y ago
  There's things which small models can't do, and where obviously a large model works better. Not emergence, I agree. I think they're using emergent for a different category of things - still things that a small model couldn't do, but specifically which a large model can just do without any of the work we thought we'd have to do for that ability. Or at least, that's how I see emergent being a useful term, both in a behavior and a value context.