3 ms·
>I think it's possible that human thought can't be simulated on a computer. It's far from obvious that it can, and this point needs justification. Fair enough.
by ikeboy 12y ago
>I think it's possible that human thought can't be simulated on a computer. It's far from obvious that it can, and this point needs justification.
Fair enough.
>Computers can only run Turing complete programs. Human intelligence follows the physical laws of the universe (the mechanism being unknown).
Those two substrates are different things; hence it's possible that humans can do things computers can't. Or at least the burden of proof is on the person who posits that they are equivalent.
The Church–Turing thesis directly says that computers can do anything humans can, and it's pretty well accepted.
Physical laws, as far as we can tell, are Turing computable. I think once you accept the materialistic thesis you should agree that computers can in theory simulate humans, and I'm not really too interested in the opinion on this of anyone who rejects the materialistic thesis.
(Penrose has tried to argue that computation depends on QM, but I think he's been largely disproven.)
>We have the facility to use computers to achieve our goals, but AI algorithms don't use us to achieve their goals, to the extent that they have goals.
Why couldn't they? Why couldn't an AI convince someone to do what they want?
>For a concrete task: consider producing a movie that will win an Oscar. In theory this is possible: the Godfather has a very limited number of bits, all of which can fit on a single computer many times over. The bits could just be manufactured it out of thin air.
>In practice I suspect a computer would need physical agency in the world to create such a movie. It would need the ability to negotiate with Hollywood producers to raise funding; to make creative decisions to direct people who operate cameras, microphones, lighting, etc.
Assuming it had access to an internet dump, it could download thousands of existing movies, determine what characteristics are likely to win Oscars, and generate voice and picture based on previous videos. Voice can definitely be generated using information already online, and video should be possible to patch together from existing movies and pictures.
>Computers don't yet have physical agency, and I suspect they won't for quite some time, for both technological and non-technological reasons.
See http://slatestarcodex.com/2015/04/07/no-physical-substrate-no-problem/ http://slatestarcodex.com/2015/04/07/no-physical-substrate-n....
About Roko's basilisk: Yudkowsky does not take the idea seriously. See https://www.reddit.com/r/Futurology/comments/2cm2eg/rokos_basilisk/cjjbqqo https://www.reddit.com/r/Futurology/comments/2cm2eg/rokos_ba... and https://www.reddit.com/r/xkcd/comments/2myg86/xkcd_1450_aibox_experiment/cm8vn6e https://www.reddit.com/r/xkcd/comments/2myg86/xkcd_1450_aibo....
>As I said, practically speaking, we should be focusing on the bazillions of problems that computing and the special AI that is already here present. In the 50 year time frame, the planet could be destroyed or the population could be decimated for many other reasons.
Do you say we shouldn't worry about climate change because it's in the future?
- chubot 12y ago> The Church–Turing thesis directly says that computers can do anything humans can, and it's pretty well accepted. Huh? It doesn't say anything close to that. That wouldn't even be mathematics. > Physical laws, as far as we can tell, are Turing computable. Not true either. Where are you getting this idea? I accept the materialistic thesis. I think people are conflating this thesis and the statement of whether human thought can be simulated on computers. That doesn't follow. A computer and the universe are not the same thing. They work in different ways and have different laws. > Why couldn't they? Why couldn't an AI convince someone to do what they want? I'm not saying they couldn't in principle. I'm not even rejecting strong AI in principle. I'm saying that in practice, with the current state of technology and reasonable extrapolation of it, this possibility is beyond consideration. There isn't a credible technical path from specialized AI to strong AI -- where we would be "surprised" that we developed it, and it would all of the sudden take over the world. If we are close technologically to strong AI, we'll know it. The alternative would be like "accidentally" creating an atom bomb, without the Manhattan project (to borrow an example from Bostrom). > Do you say we shouldn't worry about climate change because it's in the future? We absolutely should worry about climate change because we have lots of evidence that it's happening, and will continue to happen. That isn't the case with strong AI. What this article, and other AI practitioners, are saying is: The idea that computers could overthrow us all of the sudden is based on a technological misunderstanding. FWIW in college I was very interested AI: reading Kurzweil's books, considering myself a futurist, etc. I now work at Google in the same department as Kurzweil, Deep Mind, Quantum Computing, etc. Though I don't work in AI per se, and I'm not an expert in it, I'm very excited about specialized AI (which is here), and also the possibility of strong AI. I say that even though strong AI hasn't been proved to be possible in principle: we may need a different mode of computation, in addition to multiple other algorithmic / scientific breakthroughs. I'm saying that we don't have to worry yet. There are more important things to worry about, which relate directly to computing and specialized AI. Your arguments are not precise, and you have the burden of proof.
- ikeboy 12y agoI just looked over the Wikipedia on the Church Turing thesis and digital physics, and I still think that's right. The thesis says that a computer can compute anything a human can. You're right that it can't be proven, because "what a human can do" isn't formalized, but it still has almost universal acceptance. (The "strong" version does not have as much acceptance.) As for the universe being Turing computable, I think a strong argument can be made that it is (all known fundamental laws are computable by a probabilistic TM as far as I know), but even if it isn't, whatever force and law violates Turing computableness should be useble by a machine. If some kind of halting oracle exists in human minds, and humans are not unique (per materialistic thesis), then we should be able to put that oracle into a computer. On timelines: the argument I've seen is that it takes a long time to solve problems this difficult, so we need to start working on safety well in advance of Strong AI being made. I'll get to your other points later.