3 ms·
Would be cool to have a benchmark with actually unsolved math and science questions, although I suspect models are still quite a long way from that level.
by olalonde 9mo ago
Would be cool to have a benchmark with actually unsolved math and science questions, although I suspect models are still quite a long way from that level.
- deleted 9mo ago[deleted]
- gowld 9mo agoDoes folding a protein count? How about increasing performance at Go?
- fc417fc802 8mo ago"Optimize this extremely nontrivial algorithm" would work. But unless the provided solution is novel you can never be certain there wasn't leakage. And anyway at that point you're pretty obviously testing for superintelligence.
- optimalsolver 8mo agoIt's worth noting that neither of those were accomplished by LLMs.