3 ms·
They are already above average human level on many tasks, like math benchmarks.
by cubefox 2y ago
They are already above average human level on many tasks, like math benchmarks.
- kranuck 2y agoIf you ignore the part where there proofs are meandering drivel, sure.
- cubefox 2y agoEven if you don't ignore this part they (e.g. o1-preview) are still better at proofs than the average human. Substantially better even.
- cudgy 2y agoSo are calculators …
- lawn 2y agoYes, there are certain tasks they're great at, just as AI has been superhuman in some tasks for decades.
- amusedcyclist 2y agoThey really aren't better than humans at math or logic, they are good at the benchmarks because they are hyper optimized for the benchmarks lol. But if you ask LLMs simple logical questions they still get them wrong all the time