4 ms·
Perceptrons are, by design, analogous to organic neurones — only analogies, not fantastic models. Likewise the artificial networks are analogies to organic netw
by ben_w 3y ago
Perceptrons are, by design, analogous to organic neurones — only analogies, not fantastic models. Likewise the artificial networks are analogies to organic networks.
It's therefore not surprising that the artificial behaves analogously to the organic, but it would be a mistake to assume they reproduce us accurately: GPT-3 is about a thousand times less complex than a human, while trained on more text than any of us could experience in ten millennia and only text. It has no emotions, unless the capacity to simulate affect happened to lead to this as an emergent property by accident (which I can't rule out but don't actually expect to be true).
- BobbyJo 3y ago> GPT-3 is about a thousand times less complex than a human Also note that it takes the 'brute force' approach to architecture by using a transformer model, basically learning a connection graph from scratch. If you want that to scale to human complexity in function, you're probably going to have to overshoot in size by an order of magnitude.
- PaulHoule 3y agoI find it pretty remarkable how in many visual recognition neural networks (say for the MNIST digits) you see neurons close to the input layer that respond similarly to neurons in the V1 area of the visual cortex. http://www.lifesci.sussex.ac.uk/home/George_Mather/Linked%20Pages/Physiol/Cortex.html http://www.lifesci.sussex.ac.uk/home/George_Mather/Linked%20...
- p1esk 3y agoGPT-3 is about a thousand times less complex than a human How did you figure that? How many synapses are dedicated to text processing in a human brain? How much information do those synapses encode compared to the information encoded in GPT-3? How about GPT-4?
- Filligree 3y agoI don't think GP was restricting 'human' to 'text processing elements of a human'. At any rate, it's certainly true that GPT-3 is missing a great deal. So is GPT-4.
- ben_w 3y agoCorrect; mine was an overall statement rather than purely about human language processing.
- __loam 3y agoEstimates for how much information the brain encodes are several orders of magnitude higher than the biggest llm, to the point where trying to replicate it is pushing the boundaries of computability. The brain is also significantly more adaptable and generalized thanks to neuroplasticity.
- FrustratedMonky 3y agoSure, they are modeled. One is math, one is atoms. But look at a single 'real' neuron, it is just calcium ions, electrical potentials, there is no 'emotion'. Once you can completely model a 'real' neuron (I know there is still some scale to achieving this). Then link together these exactly modeled 'real' neurons. What is to say it is not experiencing 'emotions'. Even though it is silicon. Humans give themselves too much credit for being special. "I feeeeeel, the computer can't". That is just not understanding yourself.
- __loam 3y agoYou clearly lack understanding here too. Simulating "real" neurons at the scale required to simulate a brain is probably np hard. Even if we wanted to try, we don't have any maps of neuron connectivity with nearly the resolution required to do so.
- ben_w 3y agoI think the bigger problem is we have no idea what the necessary or sufficient requirements are, neither for qualia nor for intelligence. (Not sure why you think it's np rather than just lots?) With intelligence we can at least tell when we've achieved it, to whatever standard we like. Emotions could probably be a thing where we can map some internal state to some emotional affect display, eventually; but what about any question of emotional qualia? AFAICT, we don't even have a good grasp of the question yet. We each have access only the one inside our own head, and minimal capacity to even share what these are like with each other. When did you learn about aphantasia, for example? Is there a word for equivalents for that for other senses besides vision? I can "visualise" sounds and totally override the direction of down coming from my inner ears, but I can't "visualise" smells, and I don't have a non-visually oriented word for the idea, as both "visualise" and "imagine" clearly are and "idea" itself more subtly also is.
- _0ffh 3y ago"Qualia" are really just a reframing of (an aspect of) consciousness, which has been speculated to be purely epiphenomenal. Maybe we're just along for the ride, and our actions merely happen to mirror our decisions - or the other way around, same difference.