3 ms·
Imo this kind of makes sense - LLMs without a feedback loop can learn to have one themselves by encoding information in the previously generated tokens.
by torginus 2y ago
Imo this kind of makes sense - LLMs without a feedback loop can learn to have one themselves by encoding information in the previously generated tokens.
- imtringued 2y agoThey can't, because that would increase training loss. The training loss acts as a gatekeeper for reasoning.