4 ms·
As a researcher I've been interested in developing a RAG pipeline populated with research articles on my topic of study. Does it fit easily in the RAG approach
by SubiculumCode 3y ago
As a researcher I've been interested in developing a RAG pipeline populated with research articles on my topic of study. Does it fit easily in the RAG approach to also return excerpts from the actual documents as to help me verify, at a glance the source and veracity of LLM outputs?
- tayo42 3y agoYou can do the summarization part how ever you want. You don't even need have an llm summarize what the program found. The context that includes the answer, so you can just include that in your final response.
- pchunduri6 3y agoYes, this is an excellent RAG use-case! The vector index that I use in the repository uses EvaDB [1] to retrieve the top-K matches to the user queries from the available data sources. So, you can manually inspect the best matches to your query from the research article and verify the correctness of the LLM responses. [1] https://github.com/georgia-tech-db/evadb https://github.com/georgia-tech-db/evadb
- jarulraj 3y agoIt is currently not possible to get rigorous summaries of paper chunks using GPT-4.