3 ms·
That's very cool. How does it work? Do you train a model for each "library"?
by skerit 4y ago
That's very cool. How does it work? Do you train a model for each "library"?
- Vasyl_R 4y agowe're using LangChain underneath and we also doing RnD on fine-tuning to see and compare performance of different approaches. Can you tell me what file format is your knowledge-base? is it PDF or MS Docs or any other?
- punkspider 4y agoLately LangChain[1] and GPT-Index[2] are very popular libraries for this sort of thing. This is the vid I started out with https://www.youtube.com/watch?v=rBEHPxVHb5c https://www.youtube.com/watch?v=rBEHPxVHb5c Also that channel seems to be great. They focus only on LangChain and GPT-Index lately and post videos every few days https://www.youtube.com/@echohive https://www.youtube.com/@echohive Both have Discord servers as well. Additionally there's also this website for GPT-Index ( https://llamahub.ai/ https://llamahub.ai/ ) where people add different "connectors", like loading up your .md files, .docx files, your notion, your slack, etc. [1] https://langchain.readthedocs.io/en/latest/ [2] https://gpt-index.readthedocs.io/en/latest/
- thundergolfer 4y agoThey say they use LangChain, so it's going to be structurally similar to this MVP side-project: https://thundergolfer.com/infinite-ama https://thundergolfer.com/infinite-ama. That's a chat-bot backed by LangChain and OpenAI, which can answer some questions from my knowledge base. It's WIP, I want to add my HN comments into the mix, but the code is here: https://github.com/thundergolfer/modal-fun/tree/main/infinite-ama https://github.com/thundergolfer/modal-fun/tree/main/infinit...