3 ms·
I have a hypothesis that the smallest possible program that can handle things like natural language translation will be much smaller than we are expecting it to
by bob1029 2y ago
I have a hypothesis that the smallest possible program that can handle things like natural language translation will be much smaller than we are expecting it to be.
Anything where we are transforming information from one format to another on a ~1:1 basis without injecting additional external information (i.e., what foundation models do with their broad world knowledge).
- avidiax 2y agoI don't know what your expectation on the program's size is, but even for a constrained translation case (i.e. legal transcription between two Romance languages), I would expect you are embedding at least the size of WordNet in both languages.