3 ms·
What's _online_ RL for an LLM? Saw this on the llama 3.3 reports too...
by eggie5 2y ago
What's _online_ RL for an LLM? Saw this on the llama 3.3 reports too...
- whimsicalism 2y agoOnline RL for LLMs means you are sampling from the model, scoring immediately, and passing gradients back to the model. As opposed to, sampling from the model a bunch, getting scores offline, and then fine tuning the model on those offline scored generations.