4 ms·
> And of course, they have zero understanding of anything at all. They’re a next-token-predicting machine with an unimaginably large training set. How do the n
by sheepscreek 4y ago
> And of course, they have zero understanding of anything at all. They’re a next-token-predicting machine with an unimaginably large training set.
How do the neurons in our brain “understand” anything?
Can you believe our body is made up of > 100 trillion independent cells - each one is a “living” thing in its own right. We are not “one” living thing, but a collection of many living things - working together to achieve unbelievable results.
In that regard, we are more similar than anything ever done in computer science resembling our minds. LLMs work on probabilities and our neurons work on analog signals - both are across a range and not binary.
…to be continued.
- KyeRussell 4y agoI am honestly a bit disappointed that Simon has spent so much time playing with LLMs, and does have some interesting findings to share, but feels the need to include these inferences which I’d usually expect from drive-by HN skeptics.
- imtringued 4y agoOur brains don't do backpropagation.