3 ms·
Nobody actually understands how humans actually understand something, just like nobody actually understands how LLMs do what they do. Everybody opining about i
by Joeri 3y ago
Nobody actually understands how humans actually understand something, just like nobody actually understands how LLMs do what they do.
Everybody opining about it is doing just that: offering an opinion. Geoff Hinton’s opinion is worth more than someone else’s, but it is still an opinion.
- im_down_w_otp 3y agoI don’t know about the human part, but we absolutely understand how LLMs do what they do. They’re not magic.
- famouswaffles 3y agoNo we don't. No it's not "magic". No we don't understand what the black box is doing.
- brookst 3y agoFor some values of “we”
- famouswaffles 3y agoFor every value of we. "I understand the internals of GPT" is the fastest way to demonstrate you have no idea what you're talking about.
- chpatrick 3y agoWe understand the architecture but we don't understand the weights.
- usrbinbash 3y agoWe also understand, down to a very very very microscopic level, how neurons work. We also know a helluva lot about the architecture of the brain. Does that mean we can explain our own intelligence, how our minds actually work? Nope.