3 ms·
The way you define intelligence makes the rest of your statements tautologically true, but makes the existence claim problematic. Of course there could hypothet
by pron 10y ago
The way you define intelligence makes the rest of your statements tautologically true, but makes the existence claim problematic. Of course there could hypothetically be algorithms that better deal with uncertain environments than humans. Those problems are computationally hard to solve precisely, and you must find a decent approximation. But it is not certain at all that we could find an algorithm that consistently and significantly outperforms the one used by human brains. In fact, there are theorems that it is impossible to improve optimization algorithms indefinitely. See https://en.wikipedia.org/wiki/No_free_lunch_in_search_and_optimization https://en.wikipedia.org/wiki/No_free_lunch_in_search_and_op...
Now, suppose we don't find a better algorithm than the brain. Wouldn't better hardware make it significantly better? No, because not knowing the algorithm, we don't know how it scales with resources.
> I don't see how anyone could not concede that machine intelligence will obviously be superior to human intelligence.
Because of computational complexity. There's a lot we don't know about computation, but there are some things we do know. A layperson reading sci-fi novels could imagine an artificial brain smart enough to solve the halting problem, but even though it's easy to imagine, we know that's not actually possible, no matter what resources are at our disposal. This means there may be disappointing limitations to our ability to scale intelligence. But note that I'm not saying machine intelligence would not be superior at all; I'm saying it may not be as significantly superior as some would imagine. I don't see what beyond science-fiction makes you so sure of an obvious significant advantage.
> The space of intelligence is so much larger than the point we occupy.
Computational complexity makes this uncertain. It is possible that significantly better approximate results would require an exponential increase in resources. The hypothetical space of computation is also huge, but we know very little of it is actually reachable. If you take into account that the entire "space of intelligence" is incapable of efficiently solving NP-hard problems -- many of which are very important for science and technology -- you'll see that it must exist within paramaters that may be pretty narrow.
Also, consider this: our own intelligence, which has been sufficient for art and science and technology that could one day create an intelligence far superior to itself according to you, was really created simply to hunt animals a little better than cats and wolves, and has not evolved much since the agricultural revolution. This may indicate that intelligence may be more a step function than a smooth one. Then how many steps are there past our own? Maybe you're right and there are some more, but for me it's hard to imagine such a significant jump over us without breaking unbreakable complexity barriers. Anyway, I don't think we have enough knowledge to dismiss the possibility that there are no more steps beyond us, and that any improvement, while important and useful, may be less than dramatic.