4 ms·
> you see LLMs use a lot of scoped imports and I think this is partly because it makes the output more resilient against failure to think forward at the start.
by chrisjj 4mo ago
> you see LLMs use a lot of scoped imports and I think this is partly because it makes the output more resilient against failure to think forward at the start.
What makes you think an LLM has any such motivation? Or any motivation at all - beyond generating the most likely next token?
- wren6991 4mo agoThe fact that RLVR rewards successful trajectories. Notice I didn't use the word motivation, which you decided to use. The reason LLMs use a technique is simply because it works, and that comes straight from training (specifically RLVR post-training).