>> As such it "exhibits human-level performance" on some benchmarks, the company said. LLMs have "exhibit[ed] human-level" and even "superhuman" performance on

>> As such it "exhibits human-level performance" on some benchmarks, the company said. LLMs have "exhibit[ed] human-level" and even "superhuman" performance on benchmarks, but that doesn't tell us anything about the abilities of those systems because the benchmarks are broken, and we don't even have good metrics. What Will it Take to Fix Benchmarking in Natural Language Understanding? https://aclanthology.org/2021.naacl-main.385/ https://aclanthology.org/2021.naacl-main.385/