The original emergence paper has multiple "emergent" metrics. [1] Though, the paper this article is about [2] mentions that among the "emergent" tasks they tes

The original emergence paper has multiple "emergent" metrics. [1] Though, the paper this article is about [2] mentions that among the "emergent" tasks they tested, 92% were measuring accuracy on either exact-string-match or multiple choice, so probably just bad metrics. [1] https://arxiv.org/pdf/2206.07682.pdf https://arxiv.org/pdf/2206.07682.pdf [2] https://arxiv.org/pdf/2304.15004.pdf https://arxiv.org/pdf/2304.15004.pdf