3 ms·

But AI (as we have it today and in the foreseeable future) is nowhere near the definition of a species. It is an enormous _server farm_ doing series of matrix m

by blksv 2y ago

But AI (as we have it today and in the foreseeable future) is nowhere near the definition of a species. It is an enormous _server farm_ doing series of matrix multiplications followed by nonlinear transformations, with us, humans, supplying input data (as well as hardware, electricity, and maintenance) and assigning meaning to the outputs. And we have completely no ideas of doing "AI" any other way. I agree, that AI may be dangerous if used for destructive purposes, or if used for some critical tasks with too much trust (and the hype that "we're so dangerously near a superintelligence" makes the latter much more likely, in my opinion). But that Humanity will be displaced by autonomous server farms? No way. (As to the original comment, I think that a bunch of nearly(?) demented elders holding nuclear buttons is a much worse (and immediate!) threat than a server farm which we finally conclude to be intelligent.)

0xDEAFBEAD 2y ago
>But AI (as we have it today and in the foreseeable future) is nowhere near the definition of a species. It is an enormous _server farm_ doing series of matrix multiplications followed by nonlinear transformations, with us, humans, supplying input data (as well as hardware, electricity, and maintenance) and assigning meaning to the outputs. And we have completely no ideas of doing "AI" any other way. One gorilla says to the other: "Those human brains are just synapses firing. They depend on nature to survive. Not a problem" Another way of thinking about it... Suppose we create a server emulation of a highly intelligent, manipulative serial killer, and speed up the emulation so it thinks 1000x as fast as a human. How do you feel about this? Is the fact that it's "just a server farm" reassuring?
- blksv 2y ago
  > "Those human brains are just synapses firing. They depend on nature to survive. Not a problem" When it comes to AI we have just a lone detached brain, not in control over anything, so that it cannot even "fire" by itself: someone has to provide its inputs. > Suppose we create a server emulation of a highly intelligent, manipulative serial killer <...> How do you feel about this? Quite indifferent: the only field I can see for such a simulation is game development, but that would be huge overkill.
  - 0xDEAFBEAD 2y ago
    >When it comes to AI we have just a lone detached brain, not in control over anything, so that it cannot even "fire" by itself: someone has to provide its inputs. By assumption, this AI has already been created, so presumably someone is willing to do that -- and given its superhuman manipulation abilities, their willingness will probably not change.
    - blksv 2y ago
      Then, AI's abilities are effectively limited by those of this malicious operator who has to understand and perform what the AI suggests and feed back the results.
      - 0xDEAFBEAD 2y ago
        Not true for a couple reasons: * If the malicious operator has a superhuman advisor, that will increase their ability * If the emulation gets connected to the internet, it can work way faster. Many jobs can be done remotely The broader point is: abandon wishful thinking and actually consider the possibility of a worst-case scenario
        blksv 2y ago
        > If the malicious operator has a superhuman advisor, that will increase their ability Only when it comes to information processing. The inputs may (and will) be incomplete, incorrect, ambiguously formulated... The outputs may (and will) be misunderstood. And misunderstood instructions may (and will) be poorly performed. > If the emulation gets connected to the internet, it can work way faster. Many jobs can be done remotely What one man has connected, some other always can disconnect... And not anything is on the internet. > abandon wishful thinking and actually consider the possibility of a worst-case scenario The problem with all those scenarios is equating superintelligence with omniscience and omnipotence, which is plain wrong. Physics matters.

by blksv 2y ago

0xDEAFBEAD 2y ago

>But AI (as we have it today and in the foreseeable future) is nowhere near the definition of a species. It is an enormous _server farm_ doing series of matrix multiplications followed by nonlinear transformations, with us, humans, supplying input data (as well as hardware, electricity, and maintenance) and assigning meaning to the outputs. And we have completely no ideas of doing "AI" any other way. One gorilla says to the other: "Those human brains are just synapses firing. They depend on nature to survive. Not a problem" Another way of thinking about it... Suppose we create a server emulation of a highly intelligent, manipulative serial killer, and speed up the emulation so it thinks 1000x as fast as a human. How do you feel about this? Is the fact that it's "just a server farm" reassuring?

blksv 2y ago
> "Those human brains are just synapses firing. They depend on nature to survive. Not a problem" When it comes to AI we have just a lone detached brain, not in control over anything, so that it cannot even "fire" by itself: someone has to provide its inputs. > Suppose we create a server emulation of a highly intelligent, manipulative serial killer <...> How do you feel about this? Quite indifferent: the only field I can see for such a simulation is game development, but that would be huge overkill.
- 0xDEAFBEAD 2y ago
  >When it comes to AI we have just a lone detached brain, not in control over anything, so that it cannot even "fire" by itself: someone has to provide its inputs. By assumption, this AI has already been created, so presumably someone is willing to do that -- and given its superhuman manipulation abilities, their willingness will probably not change.
  - blksv 2y ago
    Then, AI's abilities are effectively limited by those of this malicious operator who has to understand and perform what the AI suggests and feed back the results.
    - 0xDEAFBEAD 2y ago
      Not true for a couple reasons: * If the malicious operator has a superhuman advisor, that will increase their ability * If the emulation gets connected to the internet, it can work way faster. Many jobs can be done remotely The broader point is: abandon wishful thinking and actually consider the possibility of a worst-case scenario
      - blksv 2y ago
        > If the malicious operator has a superhuman advisor, that will increase their ability Only when it comes to information processing. The inputs may (and will) be incomplete, incorrect, ambiguously formulated... The outputs may (and will) be misunderstood. And misunderstood instructions may (and will) be poorly performed. > If the emulation gets connected to the internet, it can work way faster. Many jobs can be done remotely What one man has connected, some other always can disconnect... And not anything is on the internet. > abandon wishful thinking and actually consider the possibility of a worst-case scenario The problem with all those scenarios is equating superintelligence with omniscience and omnipotence, which is plain wrong. Physics matters.