2 ms·
Wrong, buddy. Many of the top AI services use human feedback to continuously apply "reinforcement learning" after the initial deployment of a pre-trained model
by popalchemist 10mo ago
Wrong, buddy.
Many of the top AI services use human feedback to continuously apply "reinforcement learning" after the initial deployment of a pre-trained model.
https://en.wikipedia.org/wiki/Reinforcement_learning_from_human_feedback https://en.wikipedia.org/wiki/Reinforcement_learning_from_hu...
- Aurornis 10mo agoRLHF is a training step. Inference (what happens when you use an LLM as a customer) is separate from training. Inference and training are separate processes. Using an LLM doesn’t train it. That’s not what RLHF means.
- popalchemist 10mo agoI am aware, I've trained my own models. You're being obtuse. The big companies - take Midjourney, or OpenAI, for example - take the feedback that is generated by users, and then apply it as part of the RLHF pass on the next model release, which happens every few months. That's why they have the terms in their TOS that allow them to do that.