3 ms·
> It’s not impossible, obviously—humans do it It's still not at all obvious to me that LLMs work in the same way as the human brain, beyond a surface level. Ob
by Wowfunhappy 8mo ago
> It’s not impossible, obviously—humans do it
It's still not at all obvious to me that LLMs work in the same way as the human brain, beyond a surface level. Obviously the "neurons" in neural nets resemble our brains in a sense, but is the resemblance metaphorical or literal?
- Yiin 8mo agohttps://www.youtube.com/watch?v=l-OLgbdZ3kk https://www.youtube.com/watch?v=l-OLgbdZ3kk
- jdub 8mo agoDigital neural networks and "neurons" were already vastly simpler than biological neural networks and neurons... and getting to transformers involved optimisations that took us even further away from biomimicry.
- Filligree 8mo agoI didn’t mean “possible for LLMs”; this is clearly an open question. In fact, I didn’t even mean “possible for a neural network the size of an LLM”. I just meant “possible”.
- Wowfunhappy 8mo agoI'm not actually convinced that computers can replicate what our brains do. I don't know that a turing machine is sufficient for that.