3 ms·
I'm very curious as to how they are able to limit the chat bot's knowledge to their own documentation. It seems as if it should also have the entire knowledge
by sebastiennight 4y ago
I'm very curious as to how they are able to limit the chat bot's knowledge to their own documentation.
It seems as if it should also have the entire knowledge of the LLM, but
> Who was Thomas Jefferson?
Outputs
> Hmm, I'm not sure. I'm an AI assistant for the open source library LangChain. You can find more information about LangChain at https://langchain.readthedocs.io https://langchain.readthedocs.io.
- rafaquintanilha 4y agoYou can actually train the model to have access only to a specific body of text, like a documentation. Very useful article explaining this approach: https://dagster.io/blog/chatgpt-langchain https://dagster.io/blog/chatgpt-langchain
- sebastiennight 4y agoWow that was a fascinating read! Thank you. It doesn't explain why the model only refers to the documentation though. Basically what they are doing is giving GPT-3 a prompt that includes the (semantically relevant) pieces of the documentation. But I don't see why a User can't ask about something that is tangentially relevant ("Who is Bill Gates?") and get an answer that really comes from GPT-3 pre-existing knowledge. And very clever way for these guys to go from "hey we found this cool problem" to "well, did you notice that it ends up super complex and slow? Well well well, we could make it so much better with... wait for it... a data pipeline!" ("...and don't we just happen to sell data pipeline software! What a coincidence!") lol. Great read, thank you for the recommendation.