5 ms·
Is RAG just a fancy term for sticking an LLM in front of a search engine?
by ravenstine 3y ago
Is RAG just a fancy term for sticking an LLM in front of a search engine?
- chuckhend 3y agoTo oversimplify, its more like sending a block of text to an LLM and asking it to answer a query based on that block of text.
- politelemon 3y agoI'll also attempt an answer. You chop up your documents into chunks. You create fancy numbers for those chunks. You take the user's question and find the chunks that kind of match it. You pass the user's question with the document to an LLM and tell it to produce a nice looking answer. So it's a fancy way of getting an LLM to produce a natural looking answer over your chunky choppy search.
- esafak 3y agoThe other way round. You stick a search engine in front of your LLM to selectively feed it facts relevant to your query, which the LLM synthesizes in its own words.