3 ms·
OK, that makes some sense. > In this case it would be pretty easy for the LLM to reason about how often t appeared in the sentence. I’m not sure that follows
by xanderlewis 3y ago
OK, that makes some sense.
> In this case it would be pretty easy for the LLM to reason about how often t appeared in the sentence.
I’m not sure that follows though; is it true that LLMs already find it easy to ‘reason’ about how often (token) appears in some given text? I don’t think so.
- genrilz 3y agoI've only used small local LLMs, which definitely have issues counting and doing math. From what I've seen other commenters do in other HN threads though, it seems like GPT-4 level LLMs do a reasonably good job counting.