4 ms·
The first performance above 34% on Moments-in-Time. That MiT test looks like it begins to approximate general intelligence. Can they get the other 65% (or wha
by ilaksh 7y ago
The first performance above 34% on Moments-in-Time.
That MiT test looks like it begins to approximate general intelligence. Can they get the other 65% (or whatever it actually is) with the existing paradigm?
- Mathnerd314 7y agoI looked for a bit at the MiT dataset paper (https://arxiv.org/pdf/1801.03150.pdf https://arxiv.org/pdf/1801.03150.pdf) and I'm honestly not sure what human / general intelligence would be. There's only a single ground-truth category per video, but the categories overlap somewhat and multiple categories can apply. And the ground truth category is only 75-85% agreed upon by humans for some videos. The dataset was not constructed to have 100% performance by humans. I guess to evaluate accuracy fairly you'd have to run another Amazon Turk project, where you run a classifier over the data, take the top 5 and replace the bottom one with the ground truth if it's not there, and then quiz the workers as to the best category. But it's a million videos.