3 ms·
I think it is also important to remember that intelligence isn't clearly defined. It seems a lot of people interpret it in different ways and the definition is
by godelski 7y ago
I think it is also important to remember that intelligence isn't clearly defined. It seems a lot of people interpret it in different ways and the definition is closer to pornography (I know it when I see it).
I often see two camps, one that defines intelligence to be more human like. Limiting it to really cetaceans and hominids. Maybe including ravens. The other group gives too vague of a definition.
Personally, I do not see a problem with having lots of bins. I don't think many disagree that intelligence is a continuum. So why restrict it to very high level bins? Because that's the vernacular usage? I for one vote for the many bin and continuum approach. In this I think you could say that ML has some extremely low level form of intelligence, but I would generally say lower level than that of an ant. In that respect, a multi agent system with the intelligence surpassing that of ants I believe would be extremely impressive.
- Barrin92 7y ago>So why restrict it to very high level bins? I don't think it's a quantitative issue (the level of the bin). It's a qualitative issue. When people say that ML lacks intelligence what they're saying is that it lacks robustness, common sense, agent like behaviour, the ability to reason and so on. Intelligence (in humans or animals) does not appear to be just data driven pattern matching. I think we can say this with some confidence given that even the fanciest ML algorithm still hopelessly sucks at performing tasks that are trivial even for barely intelligent animals.
- m00x 7y ago> Intelligence (in humans or animals) does not appear to be just data driven pattern matching. I think we can say this with some confidence given that even the fanciest ML algorithm still hopelessly sucks at performing tasks that are trivial even for barely intelligent animals. Do you mind expanding on this? A lot of the tasks primitive animals can be replicated by Deep RL algorithms given the same environment. Humans adapt to sensor information, memory and a reward/penalty system just like RL. We're just much more advanced and have sophisticated systems to sense and act.
- Barrin92 7y ago>A lot of the tasks primitive animals can be replicated by Deep RL algorithms given the same environment. Highlighted the last part because this is the key difference. Humans and animals can navigate unknown and unstructured and open-ended environments. You can identify a dangerous predator without having to see ten thousand images of mauled bodies. Humans and animals can generalise in a way that is robust and independent from 'data' because they understand what they see. RL algorithms have no understanding of the world. If you let an RL system play breakout but you resize the paddle by five pixels and tilt it by 2 degrees it cannot play the game. Daniel Dennett helped popularise the notion of Umwelt, which is losely translated someone's self-centered world as subjectively perceived by an organism and filled with meaning and a notion of how the agent relates to it. It's distinct from an objective 'environment' that everyone shares. Machines lack this notion, they have no real concept of anything, even the fanciest algorithms. Which is also why conversational agents have only really made advances on one front, which is understanding sound and turning text into nice soundwaves. They have made virtually no progress in understanding irony, or ambiguity or anything that requires having an understanding of the human Umwelt. We don't even have any idea how the mind constructs this sort of interior representation of the world at all, and my prediction is we're not going to if we continue to talk about layers of neurons instead of talking about what the possible structure of a human or animal mind is.
- wilg 7y agoWell, what if you trained on the unbelievable amount of data that enters the human brain? Like, say inputting years of high definition video, audio, proprioception, introspection, debug and error logs, data from a bunch of other sensors, etc. Then put that in a really tight loop with high precision motion and audio output devices, and keep learning. Also do it on a really fast computer with lots of memory. Also make the code itself an output. If thats not enough, you could always try self replicating to try to create more successful versions over million year timescales.
- Barrin92 7y agoThat's trivially true in the sense that this is how we can only assume humans and animals came to be but I don't think there's any guarantee that this can be replicated in a silicon-based software architecture which is very different from analog and chemical biological organisms. Today already energy and computional costs are high with model computation cost going into five or six figures even in just one domain. But more importantly, I think the problem with this approach is that it's essentially a hail mary of sorts with potentially zero scientific insight into how the brain and the mind works. It's a little bit like behaviourism before the cognitive revolution with AI models being the equivalent of a Skinner box.