4 ms·

Here is lengthy debate by some of best minds in the field: http://wiki.lesswrong.com/wiki/The_Hanson-Yudkowsky_AI-Foom_Debate http://wiki.lesswrong.com/wiki/The

Here is lengthy debate by some of best minds in the field: http://wiki.lesswrong.com/wiki/The_Hanson-Yudkowsky_AI-Foom_Debate http://wiki.lesswrong.com/wiki/The_Hanson-Yudkowsky_AI-Foom_... TL:DR - whether AI can become significantly smarter than Humans really fast depends on intelligence return on computational investment.

maaku 13y ago
I'm not sure Hanson or Yudkowsky have the credentials to be considered the "best minds in the field." It makes for interesting reading though.
- TrainedMonkey 13y ago
  I did not know that, can you please point me to people with better credentials that discuss the topic in such detail?
  - maaku 13y ago
    Ben Goertzel, who is a bona fide AI researcher and was connected with SIAI/MIRI before a leadership split, has written about the topic: http://multiverseaccordingtoben.blogspot.com/2010/10/singularity-institutes-scary-idea-and.html http://multiverseaccordingtoben.blogspot.com/2010/10/singula... http://jetpress.org/v22/goertzel-pitt.htm http://jetpress.org/v22/goertzel-pitt.htm You might find some other related commentary with the search term "scary idea", which is what Ben has labeled Yudkowsky's side of the FOOM debate typified by the "That Alien Message" story. TL;DR: Goertzel takes friendliness seriously but considers a fast, hard FOOM to be implausible and worrying over it detrimental to the cause. I don't know of anyone else with qualifications to be counted as a "top AI researcher" that has covered these topics in any significant detail. Those few times I have seen the topic mentioned in interviews (with Pei Wang and Hugo de Garis, for example), it's dismissed out of hand as crazy-talk. You may find some discussion of this at the various AGI conferences though (use search terms like "friendly" or "safe" on the youtube channels).
    - maaku 13y ago
      Regarding Hugo de Garis, I should qualify that he does believe some sort of Terminator/Matrix-like war against the machines is the most likely outcome, but he places this far in the future indicating that he definitely doesn't believe in a Yudkowsky-like hard-FOOM. He's also the only AI researcher I know that takes Hollywood-like human/machine war seriously, myself included.

maaku 13y ago

I'm not sure Hanson or Yudkowsky have the credentials to be considered the "best minds in the field." It makes for interesting reading though.

TrainedMonkey 13y ago
I did not know that, can you please point me to people with better credentials that discuss the topic in such detail?
- maaku 13y ago
  Ben Goertzel, who is a bona fide AI researcher and was connected with SIAI/MIRI before a leadership split, has written about the topic: http://multiverseaccordingtoben.blogspot.com/2010/10/singularity-institutes-scary-idea-and.html http://multiverseaccordingtoben.blogspot.com/2010/10/singula... http://jetpress.org/v22/goertzel-pitt.htm http://jetpress.org/v22/goertzel-pitt.htm You might find some other related commentary with the search term "scary idea", which is what Ben has labeled Yudkowsky's side of the FOOM debate typified by the "That Alien Message" story. TL;DR: Goertzel takes friendliness seriously but considers a fast, hard FOOM to be implausible and worrying over it detrimental to the cause. I don't know of anyone else with qualifications to be counted as a "top AI researcher" that has covered these topics in any significant detail. Those few times I have seen the topic mentioned in interviews (with Pei Wang and Hugo de Garis, for example), it's dismissed out of hand as crazy-talk. You may find some discussion of this at the various AGI conferences though (use search terms like "friendly" or "safe" on the youtube channels).
  - maaku 13y ago
    Regarding Hugo de Garis, I should qualify that he does believe some sort of Terminator/Matrix-like war against the machines is the most likely outcome, but he places this far in the future indicating that he definitely doesn't believe in a Yudkowsky-like hard-FOOM. He's also the only AI researcher I know that takes Hollywood-like human/machine war seriously, myself included.