3 ms·
I think you're hitting on a more fundamental issue: benchmarks are pointless. It'd be extremely trivial to write a program that gets tired of doing the same thi
by somenameforme 4y ago
I think you're hitting on a more fundamental issue: benchmarks are pointless. It'd be extremely trivial to write a program that gets tired of doing the same thing, or that wants to engage in another task. And so if you set that as a benchmark for anything, it will likely be achieved by gaming everything to focus on the benchmark, rather than as a component of the real target.
With something like AGI you don't need a benchmark, because it would be undeniable to anybody. AGI would be able to effectively learn from any form of material I give to it, apply the material in novel and creative ways, and generally and competently execute any task related to the material or its derivatives without further input. The obvious catch is in that definition one also gets recursively better self improvement, so AGI would trend towards rapidly becoming more capable than any given human, or even humanity as a collective, in every field imaginable (or not even yet imagined). It's this catch that makes one wonder if it will ever be possible.
So many of the things we now view as absurd in the past came from people extrapolating outward from exponential progress in a field. As we discover the ever more exotic mysteries of our world, such as tree bark that takes away ones pain when chewing on it (also known as aspirin), why should we not expect there to be some fountain to reverse aging just waiting to be discovered? The universe is endlessly bizarre and interesting, but always seems to have this habit of cutting short the fun just before it becomes game breaking.