7 ms·
I've published a few papers and spent the last five years at MSR working in AI. I'm not particularly distinguished, but I believe I qualify as an expert. The R
by freeone3000 4y ago
I've published a few papers and spent the last five years at MSR working in AI. I'm not particularly distinguished, but I believe I qualify as an expert.
The RL model made the responses more useful by determining what is and is not a useful reply, then re-running on non-useful replies. It doesn't actually increase the knowledge or the LLM in a meaningful way; it does increase the precision, which is viewed as a form of increased performance? But the RL model cannot inject new facts, and cannot perform reasoning to a greater degree than the LLM can.
- kilgnad 4y agoI see. It seems to me a lot of the issues are precision problems right? chatGPT produces answers that look correct, and if you increase the precision along the correct path in this knowledge space the lookalike answer converges into the correct answer. Let's say we layer an RL model with training that doubles the size of the current LLM. I think most of the counter examples of performance failures of chatGPT in this thread will become nill. Thanks for responding btw. Good to hear the opinion of an expert.