3 ms·
It also changes the number of tokens your LLM works with, e.g. in title case it might treat the capitals as their own tokens.
by efskap 11mo ago
It also changes the number of tokens your LLM works with, e.g. in title case it might treat the capitals as their own tokens.