4 ms·
The key bit here is whether the LLM doing the cherry picking had knowledge of the solution. If it didn't, this is a meaningful result. That's why I'd like more
by johnecheck 1y ago
The key bit here is whether the LLM doing the cherry picking had knowledge of the solution. If it didn't, this is a meaningful result. That's why I'd like more info, but I fear OpenAI is going to try to keep things under wraps.
- diggan 1y ago> If it didn't We kind of have to assume it didn't right? Otherwise bragging about the results makes zero sense and would be outright misleading.
- blibble 1y agoopenai have been caught doing exactly this before
- aluminum96 1y agoWhy do people keep making up controversial claims like this? There is no evidence at all to this effect
- blibble 1y agoit was widely covered in the press earlier in the year
- helloplanets 1y agoSource?
- samat 1y ago> would be outright misleading why would not they? what are the incentives not to?
- lucianbr 1y agoCorporations mislead to make money all the damn time.
- Dilettante_ 1y ago"You really think someone would do that, just go on the internet and tell lies?" [https://youtube.com/watch?v=YWdD206eSv0 https://youtube.com/watch?v=YWdD206eSv0]
- aluminum96 1y agoMark Chen posted that the system was locked before the contest. [1] It would obviously be crazy cheating to give verifiers a solution to the problem! [1] https://x.com/markchen90/status/1946573740986257614?s=46&t=HovHm20yH7V3qoaToWuCMA https://x.com/markchen90/status/1946573740986257614?s=46&t=H...