3 ms·
Interesting marketing for Scale AI. I'd be surprised if any foundation models started benchmarking against this. Captchas seem like the more interesting test.
by xnx 2y ago
Interesting marketing for Scale AI. I'd be surprised if any foundation models started benchmarking against this.
Captchas seem like the more interesting test. As long as there are captchas that average people can solve, but computers can't, we will still have a long way to go toward artificial intelligence.
- sebzim4500 2y agoI don't think this is necessary true. I can imagine a future in which we have robots that can do 99% of human jobs but there's one thing they are strangely bad at some otherwise unimportant skill that can be used as a captcha.
- davidgerard 2y agoThe very first thing that will happen is every company training against this benchmark, as they do every other benchmark.