3 ms·
Your opinion is based on hype, not actually understanding the problems. The original ARC is “grade-school level, multiple-choice science questions” which is no
by CooCooCaCha 2y ago
Your opinion is based on hype, not actually understanding the problems.
The original ARC is “grade-school level, multiple-choice science questions” which is not much different than existing benchmarks.
The new ARC is different because it’s resistant to memorization and, as a result, modern AI algorithms do terribly even though the problems themselves are very simple.
We are clearly missing something and acknowledging that has nothing to do with admitting we’re the “lesser intelligence”. Frankly your comment sounds cultish.
- sigmoid10 2y agoLots of people seem to have forgotten that not long ago, these questions were practically unsolvable even by the best models. Similar to how a few years before that it was impossible to come up with a model that could reliably distinguish between between cats and dogs. The frontier is moving all the time and no concrete evaluation has stood the test of time so far.
- CooCooCaCha 2y agoI never said it's impossible to beat the ARC challenge. It seems like you're making up arguments that don't exist.
- BoorishBears 2y agoYou said > Your opinion is based on hype, not actually understanding the problems. That's pretty strong wording, easily tantamount to saying it's impossible/improbable
- CooCooCaCha 2y agoThey said ARC should be beaten in the near future. I don’t think it’ll be as easy as they say since we’ve been using transformers for awhile and they still fail pretty bad at the test.
- sigmoid10 2y agoWell that comment didn't age well. But even I didn't expect such a significant improvement in one week.