3 ms·
> We don’t even know how LLMs work Speak for yourself. LLMs are a feedforward algorithm inferring static weights to create a tokenized response string. We can
by bigyabai 1y ago
> We don’t even know how LLMs work
Speak for yourself. LLMs are a feedforward algorithm inferring static weights to create a tokenized response string.
We can compare that pretty trivially to the dynamic relationship of neurons and synapses in the human brain. It's not similar, case closed. That's the extent of serious discussion that can be had comparing LLMs to human thought, with apologies to Chomsky et. al. It's like trying to find the anatomical differences between a medieval scribe and a fax machine.
- hnfong 1y agoPretty sure in most other contexts you wouldn't agree a medieval scribe knows how a fax machine works.
- ninetyninenine 1y agoAnalogies aren’t proof. Like if an analogy doesn’t apply in certain context it is not a reflection of the actual situation. It just means the analogy is bad and irrelevant. Often people who don’t know how to be logical end up using analogies as proof. And you can simply say that the analogy doesn’t apply and is inaccurate and the whole argument becomes garbage because analogies aren’t logical basis for anything. Analogies are communication cools to facilitate easier understanding they are not proofs or evidence of anything.
- ben_w 1y ago> Speak for yourself. LLMs are a feedforward algorithm inferring static weights to create a tokenized response string. If we're OK with descriptions so lossy that they fit in a sentence, we also understand the human brain: A electrochemical network with external inputs and some feedback loops, pumping ions around to trigger voltage cascades to create muscle contractions as outputs.
- bigyabai 1y agoYes. As long as we're confident in our definitions, that makes the questions easy. Is that the same as a feedforward algorithm inferring static weights to create a tokenized response string? Do you necessarily need an electrochemical network with external stimuli and feedback to generate legible text? No. The answer is already solved; AI is not a brain, we can prove this by characteristically defining them both and using heuristic reasoning.
- ben_w 1y ago> The answer is already solved; AI is not a brain, we can prove this by characteristically defining them both and using heuristic reasoning. That "can" should be "could", else it presumes too much. For both human brains and surprisingly small ANNs, far smaller than LLMs, humanity collectively does not yet know the defining characteristics of the aspects we care about. I mean, humanity don't agree with itself what any of the three initials of AGI mean, there's 40 definitions of the word "consciousness", there are arguments about if there is either exactly one or many independent G-factors in human IQ scores, and also if those scores mean anything beyond correlating with school grades, and human nerodivergence covers various real states of existance that many of us find incomprehensible (sonetimes mutually, see e.g. most discussions where aphantasia comes up). The main reason I expect little from an AI is that we don't know what we're doing. The main reason I can't just assume the least is because neither did evolution when we popped out.
- ninetyninenine 1y agoGeorge Hinton the person largely responsible about the AI revolution has this to say: https://www.reddit.com/r/singularity/comments/1lbbg0x/geoffrey_hinton_says_people_understand_very/#:~:text=MetaKnowing-,Geoffrey%20Hinton%20says%20%22people%20understand%20very%20little%20about%20how%20LLMs,generate%20words%2C%20but%20also%20meaning. https://www.reddit.com/r/singularity/comments/1lbbg0x/geoffr... https://youtu.be/qrvK_KuIeJk?t=284 https://youtu.be/qrvK_KuIeJk?t=284 In that video above George Hinton, directly says we don't understand how it works. So I don't speak just for myself. I speak for the person who ushered in the AI revolution, I speak for Experts in the field who know what they're talking aboutt. I don't speak for people who don't know what they're talking about. Even though we know it's a feedforward network and we know how the queries are tokenized you cannot tell me what an LLM would say nor tell me why an LLM said something for a given prompt showing that we can't fully control an LLM because we don't fully understand it. Don't try to just argue with me. Argue with the experts. Argue with the people who know more than you, Hinton.
- bigyabai 1y agoHinton invented the neural network, which is not the same as the transformer architecture used in LLMs. Asking him about LLM architectures is like asking Henry Ford if he can build a car from a bunch of scrap metal; of course he can't. He might understand the engine or the bodywork, but it's not his job to know the whole process. Nor is it Hinton's. And that's okay - his humility isn't holding anyone back here. I'm not claiming to have memorized every model weight ever published, either. But saying that we don't know how AI works is empirically false; AI genuinely wouldn't exist if we weren't able to interpret and improve upon the transformer architecture. Your statement here is a dangerous extrapolation. > you cannot tell me what an LLM would say nor tell me why an LLM said something for a given prompt showing that we can't fully control an LLM because we don't fully understand it. You'd think this, but it's actually wrong. If you remove all of the seeded RNG during inference (meaning; no random seeds, no temps, just weights/tokenizer), you can actually create an equation that deterministically gives you the same string of text every time. It's a lot of math, but it's wholly possible to compute exactly what AI would say ahead of time if you can solve for the non-deterministic seeded entropy, or remove it entirely. LLM weights and tokenizer are both always idempotent, the inference software often introduces variability for more varied responses. Just so we're on the same page here.
- int_19h 1y agoThe fact that it doesn't operate identically or even similarly on the physical layer doesn't mean that similar processes cannot emerge on higher levels of abstraction.