3 ms·
LLMs see tokens not words and counting is a problem for them, high context or no. Maybe the current state of the art LLM can't solve the kind of high value lon
by famouswaffles 3y ago
LLMs see tokens not words and counting is a problem for them, high context or no.
Maybe the current state of the art LLM can't solve the kind of high value long context problems you have in mind but what I can tell you though is that you won't find that out by asking it to count.