4 ms·
They’re called “lemma”
by staticautomatic 2y ago
They’re called “lemma”
- Arnavion 2y agoThe intent is the same, but as I understand it LLMs don't tokenize based on lemmas, though some of the tokens probably line up with them.
loading thread…
4 ms·