2 ms·
A lot of those human lessons learned and failures probably are incorporated in the training data. I wonder if literally telling it to perform an OODA loop in th
by akiselev 4y ago
A lot of those human lessons learned and failures probably are incorporated in the training data. I wonder if literally telling it to perform an OODA loop in those words might allow it to perform better than otherwise, using reasoning examples from the literature.
- akhayam 4y agoWell, that's something that I want to understand better. I know ChatGPT--inspired by InstructGPT--used RLHF to improve their models. Since OpenAI's model is not available, how does LangChain make sure it gets similar performance as ChatGPT without using RLHF underneath? The only other way I can think of is for them to take a core dependency on OpenAI's API which seems like a bad strategy for a promising open-source project like LangChain. How do you see this evolving?