3 ms·
aren't they the same thing? YOu query your RAG database first and pass that info along with your prompt? At least that's how I saw it done on youtube.
by cranberryturkey 2y ago
aren't they the same thing? YOu query your RAG database first and pass that info along with your prompt? At least that's how I saw it done on youtube.
- Jimmc414 2y agoLong Context: Everything is loaded into the prompt at once. RAG: Dynamically fetches only the most relevant pieces of information using semantic search.
- cranberryturkey 2y agoIsn’t there a limit to the size of the prompt?
- Jimmc414 2y agoYes, that’s one of the advantages of RAG as it helps you dynamically feed text into the model based on semantic similarity to the question as opposed to sending all text into the context window.