3 ms·
That’s not true, no one can fully explain what GPT models are doing internally. You can explain the training and inference code, but the weights themselves whic
by circuit10 3y ago
That’s not true, no one can fully explain what GPT models are doing internally. You can explain the training and inference code, but the weights themselves which do the actual computation are learned by an automatic optimisation process which you can very roughly compare to evolution and they’re not easily understandable by humans.
Relevant XKCD: https://xkcd.com/1605/ https://xkcd.com/1605/
OpenAI recently made some progress in explaining individual neurons, but only some of them and that doesn’t tell you how they interact
This is like claiming that because we have sequenced the human genome, and we are able to understand the basic instructions that DNA encodes, we now fully understand the human brain because we can just read the DNA (see the XKCD)
- dtagames 3y agoNo, it's not like that at all. We discovered DNA. We didn't invent it. The process of running any software is absolutely understood by humans because humans wrote it. In ancient times, people ascribed magical qualities to rocks. Today, they're doing it to computers.
- circuit10 3y agoNo, the model weights were not written by humans. We wrote an automatic optimisation process that found the weights on its own. No one claims it’s magical, just that we don’t understand them. Sure, we can see the low level mathematical process that is going on, but that doesn’t tell us about the high level processes and why they are happening that way. It’s similar to just understanding how neurons fire wouldn’t give us a complete understanding of the human brain Try watching by these videos that explain how neural networks work, and you’ll see how the training process find the weights on its own: https://youtube.com/playlist?list=PLZHQObOWTQDNU6R1_67000Dx_ZCJB-3pi https://youtube.com/playlist?list=PLZHQObOWTQDNU6R1_67000Dx_...
- dtagames 3y agoWeighting means counting words. Still not intelligence. Great article today here on HN: https://psyche.co/ideas/the-myth-of-machine-consciousness-makes-narcissus-of-us-all https://psyche.co/ideas/the-myth-of-machine-consciousness-ma...