4 ms·
Not a language subspace specifically, but a [learning maybe?] subspace for representing data and its relations to each other. A scaffolding that is highly trans
by solarmist 4y ago
Not a language subspace specifically, but a [learning maybe?] subspace for representing data and its relations to each other. A scaffolding that is highly transferrable between domains.
His idea is that this structure might be similar to the brain's built-in structures, which make learning easy for children. Also, that language materials naturally surface the desirable properties, which is why large language models do so well on other types of problems.