2 ms·
Too bad the article only mentions addition – which shows gradual improvement. Would have loved to see the claim of emergence supported by an example as well. A
by knallfrosch 3y ago
Too bad the article only mentions addition – which shows gradual improvement.
Would have loved to see the claim of emergence supported by an example as well.
And more importantly, if the measure is boolean, completely wrong or completely right, then, well, I do expect to see a "sudden" jump in ability.
- n2d4 3y agoThe original emergence paper has multiple "emergent" metrics. [1] Though, the paper this article is about [2] mentions that among the "emergent" tasks they tested, 92% were measuring accuracy on either exact-string-match or multiple choice, so probably just bad metrics. [1] https://arxiv.org/pdf/2206.07682.pdf https://arxiv.org/pdf/2206.07682.pdf [2] https://arxiv.org/pdf/2304.15004.pdf https://arxiv.org/pdf/2304.15004.pdf