2 ms·
Lexers work at the lexeme level, which are generally understood to be words, assuming that a word is a non-decomposable unit of language.
by jahewson 11y ago
Lexers work at the lexeme level, which are generally understood to be words, assuming that a word is a non-decomposable unit of language.
- agumonkey 11y agoSimilar to the atom / compound forms described by McCarthy.