3 ms·
Why is this incongruence? Only 20% of respondents expect "Chance of global technological progress dramatically increases after HLMI" happening 2 years after HL
by nopinsight 9y ago
Why is this incongruence?
Only 20% of respondents expect "Chance of global technological progress dramatically increases after HLMI" happening 2 years after HLMI is achieved, while 80% picks the other choice, "30 years after". (Table S4)
Here is the definition of HLMI from the survey:
"High-level machine intelligence (HLMI) is achieved when unaided machines can accomplish every task better and more cheaply than human workers."
It appears to me that if machines or software, which can be replicated billions of times in the span of two years, can do every task better and cheaper than humans, it is akin to having 100+ times more active researchers working on R&D with much higher bandwidth of communications among them than human researchers do.
It is true that we might be limited by computer hardware availability, but given that the median time of HLMI predictions is 45 years from 2016, we are unlikely to be limited by hardware then.
Another possibility is that most predictors believe they will be limited by the speed of physical experiments, my answer is that smart simulations should allow HLMI to perform many experiments without waiting for their real-world results. A recent paper from OpenAI has shown us that learning in simulations can be effectively transferred to solving real-world tasks. (https://blog.openai.com/robots-that-learn/ https://blog.openai.com/robots-that-learn/) In 45 years, the quality and scope of simulations would be far better than in 2016.
- highd 9y agoIt's sort of a weird definition for HLMI since it involves cost. I.e., if you can replace an engineer but leasing the hardware, power etc. costs more than the engineer's salary it doesn't count? This is an important point, because ignoring that it could be the case that the first HLMI requires significant computational power to run - definitely to train, I'd expect, at least. So you can have a 5x human agent on some super computer but you have to build 1000 of those before you start talking about significant impact.