2 ms·
This is an uninformed take. Much of the improvement in performance of LLM based models has been through RLHF and other RL techniques.
by vonneumannstan 1y ago
This is an uninformed take. Much of the improvement in performance of LLM based models has been through RLHF and other RL techniques.
- mbesto 1y ago> This is an uninformed take. You may disagree with this take but its not uninformed. Many LLMs use self‑supervised pretraining followed by RL‑based fine‑tuning but that's essentially it - it's fine tuning.
- vonneumannstan 1y agoI think you're seriously underestimating the importance of the RL steps on LLM performance. Also how do you think the most successful RL models have worked? AlphaGo/AlphaZero both use Neural Networks for their policy and value networks which are the central mechanism of those models.