3 ms·

But can it solve ARC?

raglof 2y ago
exactly. this is my go to question with any AI claims now :)
sigmoid10 2y ago
The original AI reasoning challenge (ARC) that predates the one recently discussed here on HN by only a year has been solved. And I have no doubt that the new one will also be solved at some point in the near future. Every time someone comes up with a supposed "AGI test" and eventually gets beaten, they just move the goalpost instead of admitting that perhaps human intelligence is not so special after all. It will probably take something truly superhuman that vastly outclasses even the smartest humans in every conceivable way before the remaining majority of humanity will dare to admit that they are now the lesser intelligence.
- deleted 2y ago
  [deleted]
- CooCooCaCha 2y ago
  Your opinion is based on hype, not actually understanding the problems. The original ARC is “grade-school level, multiple-choice science questions” which is not much different than existing benchmarks. The new ARC is different because it’s resistant to memorization and, as a result, modern AI algorithms do terribly even though the problems themselves are very simple. We are clearly missing something and acknowledging that has nothing to do with admitting we’re the “lesser intelligence”. Frankly your comment sounds cultish.
  - sigmoid10 2y ago
    Lots of people seem to have forgotten that not long ago, these questions were practically unsolvable even by the best models. Similar to how a few years before that it was impossible to come up with a model that could reliably distinguish between between cats and dogs. The frontier is moving all the time and no concrete evaluation has stood the test of time so far.
    - CooCooCaCha 2y ago
      I never said it's impossible to beat the ARC challenge. It seems like you're making up arguments that don't exist.
      - BoorishBears 2y ago
        You said > Your opinion is based on hype, not actually understanding the problems. That's pretty strong wording, easily tantamount to saying it's impossible/improbable
        CooCooCaCha 2y ago
        They said ARC should be beaten in the near future. I don’t think it’ll be as easy as they say since we’ve been using transformers for awhile and they still fail pretty bad at the test.
        sigmoid10 2y ago
        Well that comment didn't age well. But even I didn't expect such a significant improvement in one week.

exactly. this is my go to question with any AI claims now :)

The original AI reasoning challenge (ARC) that predates the one recently discussed here on HN by only a year has been solved. And I have no doubt that the new one will also be solved at some point in the near future. Every time someone comes up with a supposed "AGI test" and eventually gets beaten, they just move the goalpost instead of admitting that perhaps human intelligence is not so special after all. It will probably take something truly superhuman that vastly outclasses even the smartest humans in every conceivable way before the remaining majority of humanity will dare to admit that they are now the lesser intelligence.

deleted 2y ago
[deleted]
CooCooCaCha 2y ago
Your opinion is based on hype, not actually understanding the problems. The original ARC is “grade-school level, multiple-choice science questions” which is not much different than existing benchmarks. The new ARC is different because it’s resistant to memorization and, as a result, modern AI algorithms do terribly even though the problems themselves are very simple. We are clearly missing something and acknowledging that has nothing to do with admitting we’re the “lesser intelligence”. Frankly your comment sounds cultish.
- sigmoid10 2y ago
  Lots of people seem to have forgotten that not long ago, these questions were practically unsolvable even by the best models. Similar to how a few years before that it was impossible to come up with a model that could reliably distinguish between between cats and dogs. The frontier is moving all the time and no concrete evaluation has stood the test of time so far.
  - CooCooCaCha 2y ago
    I never said it's impossible to beat the ARC challenge. It seems like you're making up arguments that don't exist.
    - BoorishBears 2y ago
      You said > Your opinion is based on hype, not actually understanding the problems. That's pretty strong wording, easily tantamount to saying it's impossible/improbable
      - CooCooCaCha 2y ago
        They said ARC should be beaten in the near future. I don’t think it’ll be as easy as they say since we’ve been using transformers for awhile and they still fail pretty bad at the test.
        sigmoid10 2y ago
        Well that comment didn't age well. But even I didn't expect such a significant improvement in one week.