5 ms·
> That's irrelevant. Transformers are Turing complete. Whatever mathematical system underlies human cognition will thus have some expression as a transformer.
by quonn 4y ago
> That's irrelevant. Transformers are Turing complete. Whatever mathematical system underlies human cognition will thus have some expression as a transformer.
That‘s irrelevant, too, because nothing indicates that the actual transformer of, say, GPT or the training is in any way connected to such an expression of the human brain.
Linux is written in C and that‘s Turing complete. And? Therefore Linux is like the brain?
- naasking 4y ago> That‘s irrelevant, too, because nothing indicates that the actual transformer of, say, GPT or the training is in any way connected to such an expression of the human brain. It's not irrelevant, it was merely the premise for the following point, which was that transformers are trained to learn a function. Since they're Turing complete, they can thus hypothetically implement any function, including the function governing human speech, as I described. If transformers were not Turing complete, then they arguably would not be computationally powerful enough to model the brain which we know is Turing complete. What is irrelevant is trying to dismiss transformers as intelligent, or like the brain, simply because they're "merely matrix multiplications".
- uoaei 4y agoWhat is your basis for asserting that transformers (not even sure what's meant: one layer?) are Turing-complete?
- naasking 4y agoIt's a well known property: https://arxiv.org/abs/1901.03429 https://arxiv.org/abs/1901.03429
- lm28469 4y ago> What is irrelevant is trying to dismiss transformers as intelligent, or like the brain, Well there is a very very very big thing that makes it relevant, which would be the fact that we have no fucking clue on how our brain actually works. Wild claims, as always, no sources, as always
- naasking 4y agoThanks for agreeing with my point, which is that all of the people claiming that these systems are NOT like the human brain have no clue what they're talking about, and that these systems very well could operate just like the brain.
- HopenHeyHi 4y agoWinner winner chicken dinner. Could sum the argument as: Transformers appear to be approximately emulating the brain despite us not fully understanding how either works "inside". Which is weird and eerie, but plausible.
- lm28469 4y agoOne smart ape once said: extraordinary claims require extraordinary evidence The burden of proof is on you, and so far you produced nothing of value in that regard
- naasking 4y agoThe burden of proof is always on whomever is making a claim. I didn't claim transformer systems were like the brain, I simply showed the mistakes behind the arguments claiming the opposite, by showing how transformer systems could work like the brain.
- lm28469 4y ago> The burden of proof is always on whomever is making a claim Yes, you in that case, you said "ie. this is what the brain does." We don't know "what the brain does", so you can't make this claim