3 ms·

[deleted]

catchnear4321 3y ago
the claim was not made that something is simple. (other than llm output.) “look.” which can be done with an untrained eye. A hand looks simple to a child. to a doctor? orthopedic surgeon? worse, to an untrained eye, your response looks like it is from an llm. it would explain missing the nuance. not the only explanation by far, but when combined with talk of genetic effects in the footnote…
- nicklecompte 3y ago
  I deleted my comment, it was a mistake to get involved in this conversation.
  - catchnear4321 3y ago
    that wasn’t the mistake.
    - deleted 3y ago
      [deleted]
visarga 3y ago
They are complicated because they got to do something much harder than neural nets - they have to build themselves starting from a single cell. When a neural net will be able to secrete GPUs to enlarge itself like the brain, then it will do the same thing with brains. But then it would have to carry extra apparatus. A neural net doesn't need to operate for 80-90 years without servicing the hardware, brain builds redundancy from the start to compensate. And brains keep an energy budget of just a few watts, not kilowatts. Out of all that complex biology in the brain maybe just a small part of it is contributing to intelligent behavior. Most of it is for support or redundancy. So I don't care you can equal a neuron with a 3 layer MLP with 1000 neurons or more. A model that fits on a DVD can speak fluent language, write code, and solve tasks - that is the useful capacity we are looking for.
- nicklecompte 3y ago
  I deleted my comment, it was a mistake to get involved in this conversation.
jokellum 3y ago
> No, human nerve cells are not "ridiculously simple." The idea that neurons = transistors is old-fashioned That's not what the OP or the literal quote you pulled from them said. They said a single neuron is ridiculously simple _relative_ to what a clump of them can do.
- nicklecompte 3y ago
  I deleted my comment, it was a mistake to get involved in this conversation.

[deleted]

the claim was not made that something is simple. (other than llm output.) “look.” which can be done with an untrained eye. A hand looks simple to a child. to a doctor? orthopedic surgeon? worse, to an untrained eye, your response looks like it is from an llm. it would explain missing the nuance. not the only explanation by far, but when combined with talk of genetic effects in the footnote…

nicklecompte 3y ago
I deleted my comment, it was a mistake to get involved in this conversation.
- catchnear4321 3y ago
  that wasn’t the mistake.
  - deleted 3y ago
    [deleted]

visarga 3y ago

They are complicated because they got to do something much harder than neural nets - they have to build themselves starting from a single cell. When a neural net will be able to secrete GPUs to enlarge itself like the brain, then it will do the same thing with brains. But then it would have to carry extra apparatus. A neural net doesn't need to operate for 80-90 years without servicing the hardware, brain builds redundancy from the start to compensate. And brains keep an energy budget of just a few watts, not kilowatts. Out of all that complex biology in the brain maybe just a small part of it is contributing to intelligent behavior. Most of it is for support or redundancy. So I don't care you can equal a neuron with a 3 layer MLP with 1000 neurons or more. A model that fits on a DVD can speak fluent language, write code, and solve tasks - that is the useful capacity we are looking for.

nicklecompte 3y ago
I deleted my comment, it was a mistake to get involved in this conversation.

jokellum 3y ago

> No, human nerve cells are not "ridiculously simple." The idea that neurons = transistors is old-fashioned That's not what the OP or the literal quote you pulled from them said. They said a single neuron is ridiculously simple _relative_ to what a clump of them can do.

nicklecompte 3y ago
I deleted my comment, it was a mistake to get involved in this conversation.