3 ms·
I wonder what you get if you interrupt LLM evaluation in tbe middle of a word and force it not to generate the obvious next token. Say, after "load-" prohibit t
by inigyou 4mo ago
I wonder what you get if you interrupt LLM evaluation in tbe middle of a word and force it not to generate the obvious next token. Say, after "load-" prohibit the next sampled token from being "bear". What will it say instead?