5 ms·

All this talk of 'intelligence' gets confusing - it seems like the core distinction people are talking about most of the time with 'general' or 'strong' AI is r

All this talk of 'intelligence' gets confusing - it seems like the core distinction people are talking about most of the time with 'general' or 'strong' AI is really something more like Artificial Consciousness. This has issues too - if consciousness is an emergent property of a neural net with the right feedback mechanisms and training material then even if you have the right feedback mechanisms you could still create an artificial consciousness that's stupid. You see this problems in humans - depending on a lifetime of 'test data' exposure (parents, peers, environment) and the underlying brain neural net 'hardware' you can get people that believe a lot of stupid things. Maybe consciousness doesn't have to work that way and we're just dealing with a local maxima of evolution (or some reproduction/sex drive constraint), but we might end up stumbling on the ability to create a neural net with the ability to emerge a consciousness before we can craft the type of consciousness we'd want. Actually understanding how the system works is harder.

deleted 11y ago
[deleted]
vasilipupkin 11y ago
stupidity is typically correlated with low ability. If hardware insured that ability is high, then we wouldn't get a lot of stupidity from emergent consciousness
- fossuser 11y ago
  I'm not sure that's exclusively the case. Smart people in the past (and currently) have believed stupid things because of what they were exposed to and what they were optimizing on.
  - vasilipupkin 11y ago
    I didn't say it was exclusively the case. I said it was correlated. There is definitely some relationship between stupidity and inherent ability
TheOtherHobbes 11y ago
Intelligence exists in human culture, not in individual humans. A high IQ has limited usefulness without a culture it can learn from and operate in. (Ask any octopus.) Human culture persists outside of individuals, so the occasional genius can change culture and culture stays changed because collective memory is altered. This doesn't happen with individual animal intelligence. So I don't think we'll ever see a true AGI. What will happen instead is that collective cultural memory will improve, and connections between human brains will become faster and deeper - just as they have done for millennia. If there's ever a singularity it will be created by human brains operating together in a new and vastly accelerated shared state, not by silicon brains that have been programmed to appear sentient.
- fossuser 11y ago
  Your first point is what I was trying to get at - basically the culture is the 'test data' and IQ would be the capability of the 'hardware' or genetic make up of an individual brain/person in this case. I think your point about intelligence not existing in an individual is too narrow, but ultimately that comes down to how you decide to define intelligence. Not sure I agree that AGI won't happen - in fact I suspect the computing power we have now is good enough to do it, but we're just missing some insight with how.

deleted 11y ago

[deleted]

vasilipupkin 11y ago

stupidity is typically correlated with low ability. If hardware insured that ability is high, then we wouldn't get a lot of stupidity from emergent consciousness

fossuser 11y ago
I'm not sure that's exclusively the case. Smart people in the past (and currently) have believed stupid things because of what they were exposed to and what they were optimizing on.
- vasilipupkin 11y ago
  I didn't say it was exclusively the case. I said it was correlated. There is definitely some relationship between stupidity and inherent ability

TheOtherHobbes 11y ago

Intelligence exists in human culture, not in individual humans. A high IQ has limited usefulness without a culture it can learn from and operate in. (Ask any octopus.) Human culture persists outside of individuals, so the occasional genius can change culture and culture stays changed because collective memory is altered. This doesn't happen with individual animal intelligence. So I don't think we'll ever see a true AGI. What will happen instead is that collective cultural memory will improve, and connections between human brains will become faster and deeper - just as they have done for millennia. If there's ever a singularity it will be created by human brains operating together in a new and vastly accelerated shared state, not by silicon brains that have been programmed to appear sentient.

fossuser 11y ago
Your first point is what I was trying to get at - basically the culture is the 'test data' and IQ would be the capability of the 'hardware' or genetic make up of an individual brain/person in this case. I think your point about intelligence not existing in an individual is too narrow, but ultimately that comes down to how you decide to define intelligence. Not sure I agree that AGI won't happen - in fact I suspect the computing power we have now is good enough to do it, but we're just missing some insight with how.