4 ms·
Oooh, so the pre-training is token-by-token but the RL step rewards the answer based on the full text. Wow! I knew that but never really appreciated the signifi
by losvedir 2y ago
Oooh, so the pre-training is token-by-token but the RL step rewards the answer based on the full text. Wow! I knew that but never really appreciated the significance of it. Thanks for pointing that out.