4 ms·

This person doesn't understand the concept of super AI. Of course intelligence is not one dimensional. But the current limit in pretty much all of those dimensi

by DiThi 10y ago

This person doesn't understand the concept of super AI. Of course intelligence is not one dimensional. But the current limit in pretty much all of those dimensions is physical: It's the larger amount of neurons and connections we could fit in the smallest space that can pass through the pelvis while still feeding enough energy to the brain. You can imagine this as a bunch of people that speaks with each other. The faster they can communicate ideas with each other, the more potentially intelligent the group can be. Machines can surpass the speed of this collective intelligence by orders of magnitude, even if everything else is exactly as a human. This is exactly the reason we evolved to have so many brain resources for language.

Retric 10y ago
Increasing speed only get's you so far. Internal combustion performance over time and past gains are greater than all possible future gains. So, sure you might see faster gains to some limit. But, don't expect a weather forecast to be accurate out a full month etc etc. Further, to get better you need to optimize for something. You might get an AI that's really good at writing fiction, but how do you measure that and write one that's even better at writing fiction?
- skybrian 10y ago
  Sure, putting more resources into weather forecasting seems likely to have diminishing returns. But consider learning itself. Educating a human takes many years, and we can't easily transfer knowledge between humans. There's a lot of room for improvement. Transferring knowledge between machines could be much more efficient. The thing about machinery is that it scales. If you have one AI that's really good at writing fiction, you can replicate it and generate all the fiction you like. Not true of human authors. I do expect there will be other bottlenecks after think time is solved, but even without intelligence much beyond human, the ability to scale in other directions is pretty scary.
  - audunw 10y ago
    > Educating a human takes many years, and we can't easily transfer knowledge between humans. There's a lot of room for improvement. Transferring knowledge between machines could be much more efficient. You're assuming that it's possible to do efficient knowledge transfer without losing general intelligence. Maybe in order to have general intelligence about something, you need to learn it from scratch, over time, rather than just "copying" the information. Another problem is that you're assuming that you can build a powerful enough computer, and still retain the possibility to have them be programmable. That is, that you have easily programmable memory cells within the computer which can change its behavior. But to have easily programmable memory cells, they need space and infrastructure to access them, and they will interfere with critical timing paths. That's why if you build a special purpose ASIC for a task, it will always be faster than a CPU or GPU. Maybe all the things we consider useless for intelligence, like playing, sleeping, exercising etc., is actually necessary. We've certainly started to see that those who focus too much on studying by cramming don't necessarily become smarter. You can put me in the "skeptics" camp when it comes to superhuman intelligence. It may be possible, and it's fun to discuss, but it seems to me that the ones who fuzz about it are making an incredible amount of assumptions.
    - skybrian 10y ago
      Okay, but CPU's, GPU's, and ASICs can all be manufactured. And I don't see anyone building a computer whose software can't be copied unless it's for artificial reasons like DRM. So it seems like the question is whether computers as we know them can do general intelligence at all? If they can, it will be easy to clone. If they can't, then it would imply that general intelligence is something more than information processing as we know it; perhaps some kind of dualism?
      - Retric 10y ago
        How do you take a subset of knowledge from neural net A such as cats have fir and merge it with neural net B? It's not a software or hardware problem it's a data problem as it's not obvious what part of neural net A encodes fir and what part encodes cat's and how you map that to B's encoding of fir and cats while connecting them. Now, AI is not necessarily going to be neural net's, but it's also not necessarily understandable what all the little bit do, just that they work.
- DiThi 10y ago
  Increasing speed won't be the thing that makes them intelligent. But it will be the thing that will make human-level AI short lived after it's achieved, shortly progressing to another level.
rspeer 10y ago
No, the current limit is not physical, it's that nobody has any idea how general intelligence works. You do not, in fact, get general intelligence by accident by throwing a lot of connections in one place, just like you do not get a human just by throwing a lot of organic molecules and water in one place.
- phailhaus 10y ago
  > just like you do not get a human just by throwing a lot of organic molecules and water in one place. Well, not unless you have a couple billion years to sit around.
  - aetherson 10y ago
    It's worse than that! It's a couple of billion years, and a planet's worth of organic molecules and water. And, there's a least some evidence that it's even worse than that -- intelligence does not appear to be common in the universe. So it might well be a couple of billion years * a million planets worth of organic molecules and water (or a hundred million planets. Or a billion planets).
- mfav 10y ago
  As the other commenter noted, "letting a bunch of molecules sit around" was precisely where we got intelligence from in the first place. So it is possible that we reach AI just by randomly permuting connections and weights. Of course it's more likely we intelligently set (or "evolve") these connections and weights, but this allows us to set an upper bound on computation/time needed.
  - rtx 10y ago
    The probality is pretty low.
  - gls2ro 10y ago
    > As the other commenter noted, "letting a bunch of molecules sit around" was precisely where we got intelligence from in the first place. I don't think this was the case. Yes there is evolution but it is not random. Actually most of the molecules sitting around did not evolve to intelligence. In case our evolution we had natural selection. In case of AI we have artificial selection (selection made by humans) and even if we consider ourselves smart enough to do this we cannot prove that we are able to make it happen (choosing the correct AIs/algorithms to survive) until it happens. Maybe I cannot express this clear enough but the advantage natural evolution has over artificial evolution is the huge number of "experiments" - meaning it had time enough to do a lot of small changes until something worked.

by DiThi 10y ago

Retric 10y ago

Increasing speed only get's you so far. Internal combustion performance over time and past gains are greater than all possible future gains. So, sure you might see faster gains to some limit. But, don't expect a weather forecast to be accurate out a full month etc etc. Further, to get better you need to optimize for something. You might get an AI that's really good at writing fiction, but how do you measure that and write one that's even better at writing fiction?

skybrian 10y ago
Sure, putting more resources into weather forecasting seems likely to have diminishing returns. But consider learning itself. Educating a human takes many years, and we can't easily transfer knowledge between humans. There's a lot of room for improvement. Transferring knowledge between machines could be much more efficient. The thing about machinery is that it scales. If you have one AI that's really good at writing fiction, you can replicate it and generate all the fiction you like. Not true of human authors. I do expect there will be other bottlenecks after think time is solved, but even without intelligence much beyond human, the ability to scale in other directions is pretty scary.
- audunw 10y ago
  > Educating a human takes many years, and we can't easily transfer knowledge between humans. There's a lot of room for improvement. Transferring knowledge between machines could be much more efficient. You're assuming that it's possible to do efficient knowledge transfer without losing general intelligence. Maybe in order to have general intelligence about something, you need to learn it from scratch, over time, rather than just "copying" the information. Another problem is that you're assuming that you can build a powerful enough computer, and still retain the possibility to have them be programmable. That is, that you have easily programmable memory cells within the computer which can change its behavior. But to have easily programmable memory cells, they need space and infrastructure to access them, and they will interfere with critical timing paths. That's why if you build a special purpose ASIC for a task, it will always be faster than a CPU or GPU. Maybe all the things we consider useless for intelligence, like playing, sleeping, exercising etc., is actually necessary. We've certainly started to see that those who focus too much on studying by cramming don't necessarily become smarter. You can put me in the "skeptics" camp when it comes to superhuman intelligence. It may be possible, and it's fun to discuss, but it seems to me that the ones who fuzz about it are making an incredible amount of assumptions.
  - skybrian 10y ago
    Okay, but CPU's, GPU's, and ASICs can all be manufactured. And I don't see anyone building a computer whose software can't be copied unless it's for artificial reasons like DRM. So it seems like the question is whether computers as we know them can do general intelligence at all? If they can, it will be easy to clone. If they can't, then it would imply that general intelligence is something more than information processing as we know it; perhaps some kind of dualism?
    - Retric 10y ago
      How do you take a subset of knowledge from neural net A such as cats have fir and merge it with neural net B? It's not a software or hardware problem it's a data problem as it's not obvious what part of neural net A encodes fir and what part encodes cat's and how you map that to B's encoding of fir and cats while connecting them. Now, AI is not necessarily going to be neural net's, but it's also not necessarily understandable what all the little bit do, just that they work.
DiThi 10y ago
Increasing speed won't be the thing that makes them intelligent. But it will be the thing that will make human-level AI short lived after it's achieved, shortly progressing to another level.

rspeer 10y ago

No, the current limit is not physical, it's that nobody has any idea how general intelligence works. You do not, in fact, get general intelligence by accident by throwing a lot of connections in one place, just like you do not get a human just by throwing a lot of organic molecules and water in one place.

phailhaus 10y ago
> just like you do not get a human just by throwing a lot of organic molecules and water in one place. Well, not unless you have a couple billion years to sit around.
- aetherson 10y ago
  It's worse than that! It's a couple of billion years, and a planet's worth of organic molecules and water. And, there's a least some evidence that it's even worse than that -- intelligence does not appear to be common in the universe. So it might well be a couple of billion years * a million planets worth of organic molecules and water (or a hundred million planets. Or a billion planets).
mfav 10y ago
As the other commenter noted, "letting a bunch of molecules sit around" was precisely where we got intelligence from in the first place. So it is possible that we reach AI just by randomly permuting connections and weights. Of course it's more likely we intelligently set (or "evolve") these connections and weights, but this allows us to set an upper bound on computation/time needed.
- rtx 10y ago
  The probality is pretty low.
- gls2ro 10y ago
  > As the other commenter noted, "letting a bunch of molecules sit around" was precisely where we got intelligence from in the first place. I don't think this was the case. Yes there is evolution but it is not random. Actually most of the molecules sitting around did not evolve to intelligence. In case our evolution we had natural selection. In case of AI we have artificial selection (selection made by humans) and even if we consider ourselves smart enough to do this we cannot prove that we are able to make it happen (choosing the correct AIs/algorithms to survive) until it happens. Maybe I cannot express this clear enough but the advantage natural evolution has over artificial evolution is the huge number of "experiments" - meaning it had time enough to do a lot of small changes until something worked.