It feels like this can be tracked with addition. Humans expect “can do addition” is a binary skill, because humans either can or cannot add. LLMs approximate a

It feels like this can be tracked with addition. Humans expect “can do addition” is a binary skill, because humans either can or cannot add. LLMs approximate addition. For a long time they would produce hot garbage. Then after a lot of training, they could sum 2 digit numbers correctly. At this point we’d say “they can do addition”, and the property has emerged. They have passed a binary skill threshold.