3 ms·
> but there are some things one can do with a mega context that you just can't get with RAG. Can you elaborate? In my mind, RAG and "mega context" are orthogon
by andy_xor_andrew 3y ago
> but there are some things one can do with a mega context that you just can't get with RAG.
Can you elaborate? In my mind, RAG and "mega context" are orthogonal - RAG is something done by adding documents to the context for the LLM to reference, and "mega context" is just having a big context. No?
- bradfox2 3y agoI think he means not needing to have a great search system to identify rag chunks. Just throw everything in.
- brucethemoose2 3y agoOr more specifically, be able to look at everything all at once instead of in chunks.