3 ms·

There is a difference in processing between replying to "Good Morning" and typing out a comment on HN like this.

FrustratedMonky 4y ago
Maybe it's just scale. Because my brain can write something longer that was 'thought out', doesn't mean it isn't responding like an LLM. Maybe articles on AI just trigger me and I spew the same arguments. I think a lot of people have just rote responses to many situations, and maybe if they have enough rote responses, with enough variety, they start to look human, or 'intelligent'. Yeah, its more complicated than a bunch of If/Then's. Doesn't make it not mecahnical.
- cscurmudgeon 4y ago
  Maybe it's just scale and maybe it's not. We can't say it is scale from the evidence so far. > Maybe articles on AI just trigger me and I spew the same arguments. I But you are not representative of all humans. > Doesn't make it not mecahnical. There are mechanical things that are more than just prediction machines. Why did you make the "leap non-LLM" == "not mechanical"?
  - groestl 4y ago
    > But you are not representative of all humans. I actually started to type almost the same reply as your parent earlier, but did not post it. I used "difference in quantity, not quality" instead of "scale", but I also included the self observation. So maybe that makes two of us.
- IIAOPSW 4y ago
  This is simply impossible. The premise that the brain is a big lookup table is appealing, and that sort of 1 neuron = 1 represented item concept certainly happens at the initial stages of the sensory pipeline, but if you attempt to scale it up and up to higher levels of abstraction, to the point where you have neurons that have rote memorized every orientation of your grandmothers face (and everyone else's face), you would need to have far more neurons than can possibly fit in any animals head, let alone yours. This concept is literally known as a "grandmother neuron", and its widely considered to be debunked. I refer you to this neuroscience lecture. https://www.youtube.com/watch?v=_njf8jwEGRo https://www.youtube.com/watch?v=_njf8jwEGRo Beyond the simplest, most common tasks where it pays to have a rote lookup table, you truly do need an algorithm.
  - FrustratedMonky 4y ago
    Never said 1-neoron. Just that it is mechanistic. The brain is a neural net, the grandmothers face is a combination of pathways. Our responses are a combination, or pattern of pathways. LLM is just the latest example of us able to replicate part of it, just one aspect of what the brain does. Sure, the brain is more complicated, that is what I meant by scale, eventually all the aspects will be modeled and put together. It wont all be LLM.

Maybe it's just scale. Because my brain can write something longer that was 'thought out', doesn't mean it isn't responding like an LLM. Maybe articles on AI just trigger me and I spew the same arguments. I think a lot of people have just rote responses to many situations, and maybe if they have enough rote responses, with enough variety, they start to look human, or 'intelligent'. Yeah, its more complicated than a bunch of If/Then's. Doesn't make it not mecahnical.

cscurmudgeon 4y ago
Maybe it's just scale and maybe it's not. We can't say it is scale from the evidence so far. > Maybe articles on AI just trigger me and I spew the same arguments. I But you are not representative of all humans. > Doesn't make it not mecahnical. There are mechanical things that are more than just prediction machines. Why did you make the "leap non-LLM" == "not mechanical"?
- groestl 4y ago
  > But you are not representative of all humans. I actually started to type almost the same reply as your parent earlier, but did not post it. I used "difference in quantity, not quality" instead of "scale", but I also included the self observation. So maybe that makes two of us.
IIAOPSW 4y ago
This is simply impossible. The premise that the brain is a big lookup table is appealing, and that sort of 1 neuron = 1 represented item concept certainly happens at the initial stages of the sensory pipeline, but if you attempt to scale it up and up to higher levels of abstraction, to the point where you have neurons that have rote memorized every orientation of your grandmothers face (and everyone else's face), you would need to have far more neurons than can possibly fit in any animals head, let alone yours. This concept is literally known as a "grandmother neuron", and its widely considered to be debunked. I refer you to this neuroscience lecture. https://www.youtube.com/watch?v=_njf8jwEGRo https://www.youtube.com/watch?v=_njf8jwEGRo Beyond the simplest, most common tasks where it pays to have a rote lookup table, you truly do need an algorithm.
- FrustratedMonky 4y ago
  Never said 1-neoron. Just that it is mechanistic. The brain is a neural net, the grandmothers face is a combination of pathways. Our responses are a combination, or pattern of pathways. LLM is just the latest example of us able to replicate part of it, just one aspect of what the brain does. Sure, the brain is more complicated, that is what I meant by scale, eventually all the aspects will be modeled and put together. It wont all be LLM.