3 ms·
I think these LLMs have been optimized with Reinforcement Learning from Human Feedback (RLHF) Hard to tell that will add enough to get close to AGI. Google is
by sharemywin 4y ago
I think these LLMs have been optimized with Reinforcement Learning from Human Feedback (RLHF)
Hard to tell that will add enough to get close to AGI.
Google is also working on chain of thought prompting which helps with math and logic problems.
https://medium.com/nlplanet/two-minutes-nlp-making-large-language-models-reason-with-chain-of-thought-prompting-401fd3c964d0 https://medium.com/nlplanet/two-minutes-nlp-making-large-lan...
- lossolo 4y agoCOT is so yesterday! SOTA is LAMBADA[1] aka backward chaining also from Google, that significantly outperforms chain of thought and select inference in terms of prediction accuracy and proof accuracy. [1] https://arxiv.org/abs/2212.13894 https://arxiv.org/abs/2212.13894