2 ms·
The name is obviously a bit stupid, but based on the sample questions I think they did a good job of creating a harder version of the existing academic question
by sebzim4500 2y ago
The name is obviously a bit stupid, but based on the sample questions I think they did a good job of creating a harder version of the existing academic question benchmarks.
The questions are possible for a smart person familiar with the subject but still just beyond SOTA models.
My guess is that within the next few years we will have models that can ace this test but are still bizarrely bad at things we find easy.