3 ms·
>without starting out with an inborn sense of grammar I'm not so sure though, because it starts by being fed sentences assembled by people. Sort of how we wou
by coldtea 3y ago
>without starting out with an inborn sense of grammar
I'm not so sure though, because it starts by being fed sentences assembled by people.
Sort of how we wouldn't say that a book itself has a "good command of language", but that the writer has one, and put it in the book.
So you might need a seed with "an inborn sense of grammar" to create language first and a training corpus second, but once that's available in huge volumes you can mechanically train an LLM to appear to have a "good command of language" just by brute force.
Would an LLM gain a "good command of language" if it was just fed all the taling a human hears and the words it reads in its first 18 years of life?