3 ms·
The related list of ten Marcus-worthy tasks is probably more worth reading, since it at least provides some falsifiable goalposts. https://news.ycombinator.com
by krackers 2y ago
The related list of ten Marcus-worthy tasks is probably more worth reading, since it at least provides some falsifiable goalposts.
https://news.ycombinator.com/item?id=42560545 https://news.ycombinator.com/item?id=42560545
I'd argue 1, 2, maybe 6 are effectively already doable. 3 & 5 are good tasks which are technically possible with some RAG hackery but in general is a good benchmark testing out-of-context fact retrieval. 4 & 10 might happen soon-ish with work on "agents" and proof synthesis respectively. 7 & 8 are too subjective. 9, maybe weakened to formulating or proving novel theorems, might be a good baseline for "peak human" intelligence (I think at best O1-O3 can spot and prove some lemmas, but nothing that anyone would bother publishing).