4 ms·

This is hilarious and shows how ludicrous lesswrong is. It's not a website about AI but a website that has taken Hollywood science fiction way too seriously. T

This is hilarious and shows how ludicrous lesswrong is. It's not a website about AI but a website that has taken Hollywood science fiction way too seriously. They are going to get quoted a lot 30-50 years from now as a joke.

supriyo-biswas 4y ago
It is only a matter of time before research groups try controlling physical variables (such as a robot being allowed to move and manipulate its environment) based on a LLM or similar model that shows some level of general intelligence. Since larger model size has been shown to be inversely correlated with openness to ideas, it is not exactly unexpected that such a model may choose to harm humanity in certain ways. Thus, I wouldn’t call it Hollywood science fiction. At worst, the discussions on Lesswrong bear similarities to theoretical discussions about human behavior such as the trolley problem, etc.
- ctoth 4y ago
  A matter of time, as in last month[0]? :) [0]: PaLM-E: An Embodied Multimodal Language Model: https://arxiv.org/abs/2303.03378 https://arxiv.org/abs/2303.03378
- famouswaffles 4y ago
  It's already happened. We're at the point where intelligence isn't really the bottleneck anymore. https://innermonologue.github.io/ https://innermonologue.github.io/ https://palm-e.github.io/ https://palm-e.github.io/ https://www.microsoft.com/en-us/research/group/autonomous-systems-group-robotics/articles/chatgpt-for-robotics/ https://www.microsoft.com/en-us/research/group/autonomous-sy...
ImHereToVote 4y ago
Really? 30 years of AI research later? We have only started on action oriented neural networks. What will the landscape look like in 30 years?
- hprotagonist 4y ago
  try 80 years. But 40 years ago we threw in the towel on semantics.
  - ImHereToVote 4y ago
    Maybe the Chomsky theory of language is the basis of all intelligence is correct. Hell, maybe you don't need even a semblance of consciousness for highly intelligent agents. Like we have blindsight, maybe blindthought also exists.
    - random314 4y ago
      Chomsky rates language as the difference between animal and human intelligence, not the basis of all forms of intelligence. I don't think Chat GPT has the sentience and self driven goal focus of a lab rat today. In any case, Chomsky thinks of chat gpt as autocomplete on steroids, not as a form of intelligence.
      - ImHereToVote 4y ago
        It's a good thing all future neural networks will be LLMs then.
- grantcas 4y ago
  It's becoming clear that with all the brain and consciousness theories out there, the proof will be in the pudding. By this I mean, can any particular theory be used to create a human adult level conscious machine. My bet is on the late Gerald Edelman's Extended Theory of Neuronal Group Selection. The lead group in robotics based on this theory is the Neurorobotics Lab at UC at Irvine. Dr. Edelman distinguished between primary consciousness, which came first in evolution, and that humans share with other conscious animals, and higher order consciousness, which came to only humans with the acquisition of language. A machine with primary consciousness will probably have to come first. What I find special about the TNGS is the Darwin series of automata created at the Neurosciences Institute by Dr. Edelman and his colleagues in the 1990's and 2000's. These machines perform in the real world, not in a restricted simulated world, and display convincing physical behavior indicative of higher psychological functions necessary for consciousness, such as perceptual categorization, memory, and learning. They are based on realistic models of the parts of the biological brain that the theory claims subserve these functions. The extended TNGS allows for the emergence of consciousness based only on further evolutionary development of the brain areas responsible for these functions, in a parsimonious way. No other research I've encountered is anywhere near as convincing. I post because on almost every video and article about the brain and consciousness that I encounter, the attitude seems to be that we still know next to nothing about how the brain and consciousness work; that there's lots of data but no unifying theory. I believe the extended TNGS is that theory. My motivation is to keep that theory in front of the public. And obviously, I consider it the route to a truly conscious machine, primary and higher-order. My advice to people who want to create a conscious machine is to seriously ground themselves in the extended TNGS and the Darwin automata first, and proceed from there, by applying to Jeff Krichmar's lab at UC Irvine, possibly. Dr. Edelman's roadmap to a conscious machine is at https://arxiv.org/abs/2105.10461 https://arxiv.org/abs/2105.10461
ctoth 4y ago
This comment has some real First they ignore you, then they laugh at you, then they attack you, then the world turns into paperclips energy.
- random314 4y ago
  For whatever reason, every crackpot loves this quote! Bookmarked!

supriyo-biswas 4y ago

It is only a matter of time before research groups try controlling physical variables (such as a robot being allowed to move and manipulate its environment) based on a LLM or similar model that shows some level of general intelligence. Since larger model size has been shown to be inversely correlated with openness to ideas, it is not exactly unexpected that such a model may choose to harm humanity in certain ways. Thus, I wouldn’t call it Hollywood science fiction. At worst, the discussions on Lesswrong bear similarities to theoretical discussions about human behavior such as the trolley problem, etc.

ctoth 4y ago
A matter of time, as in last month[0]? :) [0]: PaLM-E: An Embodied Multimodal Language Model: https://arxiv.org/abs/2303.03378 https://arxiv.org/abs/2303.03378
famouswaffles 4y ago
It's already happened. We're at the point where intelligence isn't really the bottleneck anymore. https://innermonologue.github.io/ https://innermonologue.github.io/ https://palm-e.github.io/ https://palm-e.github.io/ https://www.microsoft.com/en-us/research/group/autonomous-systems-group-robotics/articles/chatgpt-for-robotics/ https://www.microsoft.com/en-us/research/group/autonomous-sy...

ImHereToVote 4y ago

Really? 30 years of AI research later? We have only started on action oriented neural networks. What will the landscape look like in 30 years?

hprotagonist 4y ago
try 80 years. But 40 years ago we threw in the towel on semantics.
- ImHereToVote 4y ago
  Maybe the Chomsky theory of language is the basis of all intelligence is correct. Hell, maybe you don't need even a semblance of consciousness for highly intelligent agents. Like we have blindsight, maybe blindthought also exists.
  - random314 4y ago
    Chomsky rates language as the difference between animal and human intelligence, not the basis of all forms of intelligence. I don't think Chat GPT has the sentience and self driven goal focus of a lab rat today. In any case, Chomsky thinks of chat gpt as autocomplete on steroids, not as a form of intelligence.
    - ImHereToVote 4y ago
      It's a good thing all future neural networks will be LLMs then.
grantcas 4y ago
It's becoming clear that with all the brain and consciousness theories out there, the proof will be in the pudding. By this I mean, can any particular theory be used to create a human adult level conscious machine. My bet is on the late Gerald Edelman's Extended Theory of Neuronal Group Selection. The lead group in robotics based on this theory is the Neurorobotics Lab at UC at Irvine. Dr. Edelman distinguished between primary consciousness, which came first in evolution, and that humans share with other conscious animals, and higher order consciousness, which came to only humans with the acquisition of language. A machine with primary consciousness will probably have to come first. What I find special about the TNGS is the Darwin series of automata created at the Neurosciences Institute by Dr. Edelman and his colleagues in the 1990's and 2000's. These machines perform in the real world, not in a restricted simulated world, and display convincing physical behavior indicative of higher psychological functions necessary for consciousness, such as perceptual categorization, memory, and learning. They are based on realistic models of the parts of the biological brain that the theory claims subserve these functions. The extended TNGS allows for the emergence of consciousness based only on further evolutionary development of the brain areas responsible for these functions, in a parsimonious way. No other research I've encountered is anywhere near as convincing. I post because on almost every video and article about the brain and consciousness that I encounter, the attitude seems to be that we still know next to nothing about how the brain and consciousness work; that there's lots of data but no unifying theory. I believe the extended TNGS is that theory. My motivation is to keep that theory in front of the public. And obviously, I consider it the route to a truly conscious machine, primary and higher-order. My advice to people who want to create a conscious machine is to seriously ground themselves in the extended TNGS and the Darwin automata first, and proceed from there, by applying to Jeff Krichmar's lab at UC Irvine, possibly. Dr. Edelman's roadmap to a conscious machine is at https://arxiv.org/abs/2105.10461 https://arxiv.org/abs/2105.10461

ctoth 4y ago

This comment has some real First they ignore you, then they laugh at you, then they attack you, then the world turns into paperclips energy.

random314 4y ago
For whatever reason, every crackpot loves this quote! Bookmarked!