3 ms·
With almost all of these papers, "RAG" is mentioned as a well-defined, absolute strategy. Is there an agreed upon implementation for it? Because as I have been
by kristiandupont 3y ago
With almost all of these papers, "RAG" is mentioned as a well-defined, absolute strategy. Is there an agreed upon implementation for it? Because as I have been building my own implementation, I have found that finding the right things to retrieve and augment the prompt with is incredibly challenging.
It seems to me that a great RAG would almost always outperform other strategies because it will be like giving the student a note with the answer right before the exam, compared to letting them read the whole curriculum, but I am very much still learning..
- azeirah 3y agoI think it's still a developing technique. I'm not following RAG super closely, but I keep myself somewhat updated through Sam Witteveen's videos on YouTube: https://www.youtube.com/@samwitteveenai https://www.youtube.com/@samwitteveenai His channel might be a useful resource for you.
- euazOn 3y agoOn the note of youtube channels, I can wholeheartedly recommend Prompt Engineering [1]. He has great videos and hands-on tutorials, not just about RAG, and also maintains the LocalGPT repo [2] with 17k stars. [1] https://www.youtube.com/@engineerprompt/videos https://www.youtube.com/@engineerprompt/videos [2] https://github.com/PromtEngineer/localGPT https://github.com/PromtEngineer/localGPT
- aldarisbm 3y agothe main problem with RAG IMHO is that. What if the note(s) they passed you have nothing to do with the answer you’re trying to respond to. Getting RAG to work right depending on the context is tricky. I like RAG fusion approach with rerankers.