3 ms·
The result in the theorem applies to your brain. Your brain can be modelled as an LLM in the sense of the paper up to arbitrarily small error. The result is a
by golol 3y ago
The result in the theorem applies to your brain. Your brain can be modelled as an LLM in the sense of the paper up to arbitrarily small error.
The result is a diagonalization argument that is not very relevant for the real world.
- wredue 3y ago>your brain can be modelled as an LLM in the sense of the paper The vast majority of people actually writing LLMs don’t claim this, and in fact, actually claim the very opposite: that LLMs do not accurately model a human brain in any capacity. The fact is that science has no clue what happens in the nucleus of a neuron, so claiming that computer scientists must is… well. You fill in the word.
- golol 3y agoDefinition 2 (Large Language Model). Let S be a computable seta of all the finite-length strings of alphabet A and (s0, s1, . . .) be an one-to-one enumeration of all the elements in S. A large language model, denoted h, is a function that completes the input string s ∈ S using the function’s predicted tokens h(s), in a finite time. Function h is attained procedurally using a set of training samples of input-completion pairs. For an arbtrarily large duration and an arbitrarily small error with respect to any definition of error you choose, there exists an LLM in the above sense which models the dynamics of your brain with that small error.