3 ms·
That's not what learnable means, but it would only show there needs to be an a priori limit on the structure of learning. > in some sense isomorphic given Turi
by tgv 4y ago
That's not what learnable means, but it would only show there needs to be an a priori limit on the structure of learning.
> in some sense isomorphic given Turing equivalence
Then you're brain is just like any CPU, which is very far from what such a statement tries to express in the context of NNs.
- naasking 4y ago> Then you're brain is just like any CPU, which is very far from what such a statement tries to express in the context of NNs. Yes, the brain is like a CPU + a specific program running on that CPU. The properties of that program are where the isomorphism comes in. So to come full circle back to your original point, we don't yet know that "weight adaptations" are not a sufficient operational model for that program.
- naasking 4y agoI'm also struggling to understand how you can claim that LLMs cannot learn CFGs when ChatGPT can understand nested quantifiers, which simply cannot be parsed using CFGs. LLMs can actually learn unrestricted grammars.