5 ms·

Hehe. I actually had a thought around the same lines a few days ago. https://news.ycombinator.com/item?id=35516757 https://news.ycombinator.com/item?id=3551675

Hehe. I actually had a thought around the same lines a few days ago. https://news.ycombinator.com/item?id=35516757 https://news.ycombinator.com/item?id=35516757 And what probably gives us awareness or consciousness is the multiple GPT like structures running in parallel. It really does make me wonder if we are really close to true AGI. It does feel like it. Very exciting times! Just hope we don't end up doing a Terminator.

gabereiser 3y ago
Oddly enough, we've been saying that since... The Terminator. NN's and LLM's are cool but not even close to the power of the human brain (maybe quantum llm's?). I'm keen to see how we can tap into our own minds as CPU's or at least drivers thereof. Consciousness is awareness and perception so one could say we are close to a rudimentary consciousness but we have a long way to go before it's aware. Still, even though we've been saying it for 30 years, exciting times indeed! #skynet
- MacsHeadroom 3y ago
  > LLM's are cool but not even close to the power of the human brain There are only 20 Billion Neurons in the Neocortex. GPT-3 has 175 Billion. GPT-4 scores 130 on IQ tests. They are absolutely in the realm of the power of human brains. They're just exposed to different stimuli and have very narrow input/output.
  - Teever 3y ago
    organic neurons are much more complex than simulated neurons. It's more accurate to look at an organic neuron as an entire computing device than a simple transistor.
  - felipemnoa 3y ago
    >>GPT-4 scores 130 on IQ tests Then there must be something really wrong with IQ tests. GPT-4 to me seems more like an idiot savant.
  - kordlessagain 3y ago
    An neuron and a parameter are not the same thing. Also, see Orch OR theory: https://en.m.wikipedia.org/wiki/Orchestrated_objective_reduction https://en.m.wikipedia.org/wiki/Orchestrated_objective_reduc...
  - dragonwriter 3y ago
    > There are only 20 Billion Neurons in the Neocortex. GPT-3 has 175 Billion. No, parameters are loosely analogous to synapses (they are weights on the connections between neurons) not neurons, and the neocortex is not the whole of the brain. There are about 140 trillion synapses in the neocortex, 600 trillion in the brain. And neural connections may not explain the brain's capacity, as mutual interaction with other body systems is involved. > GPT-4 scores 130 on IQ tests. Methodological issues (or simply methodological unclarity) with the reports of GPT-4 test results aside, IQ tests do not directly test general intelligence, even under the assumption that g is the same thing as general intelligence. They are a proxy which works for testing that in humans, because in humans the capacities directly tested by them correlate with g. We have no idea what IQ testing results of LLMs, even conducted appropriately, mean, if anything. > They are absolutely in the realm of the power of human brains. No, to steal from Pulp Fiction, an LLM and a human brain “ain’t even the same f###ing thing. […] Ain’t no f###ing ballpark neither. […] It ain’t the same league. It ain’t even the same f###ing sport.”

gabereiser 3y ago

Oddly enough, we've been saying that since... The Terminator. NN's and LLM's are cool but not even close to the power of the human brain (maybe quantum llm's?). I'm keen to see how we can tap into our own minds as CPU's or at least drivers thereof. Consciousness is awareness and perception so one could say we are close to a rudimentary consciousness but we have a long way to go before it's aware. Still, even though we've been saying it for 30 years, exciting times indeed! #skynet

MacsHeadroom 3y ago
> LLM's are cool but not even close to the power of the human brain There are only 20 Billion Neurons in the Neocortex. GPT-3 has 175 Billion. GPT-4 scores 130 on IQ tests. They are absolutely in the realm of the power of human brains. They're just exposed to different stimuli and have very narrow input/output.
- Teever 3y ago
  organic neurons are much more complex than simulated neurons. It's more accurate to look at an organic neuron as an entire computing device than a simple transistor.
- felipemnoa 3y ago
  >>GPT-4 scores 130 on IQ tests Then there must be something really wrong with IQ tests. GPT-4 to me seems more like an idiot savant.
- kordlessagain 3y ago
  An neuron and a parameter are not the same thing. Also, see Orch OR theory: https://en.m.wikipedia.org/wiki/Orchestrated_objective_reduction https://en.m.wikipedia.org/wiki/Orchestrated_objective_reduc...
- dragonwriter 3y ago
  > There are only 20 Billion Neurons in the Neocortex. GPT-3 has 175 Billion. No, parameters are loosely analogous to synapses (they are weights on the connections between neurons) not neurons, and the neocortex is not the whole of the brain. There are about 140 trillion synapses in the neocortex, 600 trillion in the brain. And neural connections may not explain the brain's capacity, as mutual interaction with other body systems is involved. > GPT-4 scores 130 on IQ tests. Methodological issues (or simply methodological unclarity) with the reports of GPT-4 test results aside, IQ tests do not directly test general intelligence, even under the assumption that g is the same thing as general intelligence. They are a proxy which works for testing that in humans, because in humans the capacities directly tested by them correlate with g. We have no idea what IQ testing results of LLMs, even conducted appropriately, mean, if anything. > They are absolutely in the realm of the power of human brains. No, to steal from Pulp Fiction, an LLM and a human brain “ain’t even the same f###ing thing. […] Ain’t no f###ing ballpark neither. […] It ain’t the same league. It ain’t even the same f###ing sport.”