4 ms·
RAG is broken when you have too much data.
by m00dy 9mo ago
RAG is broken when you have too much data.
- thunky 9mo agoGemini with Google search is RAG using all public data, and it isn't broken.
- fhd2 9mo agoIt's not tool use with natural language search queries? That's what I'd expect.
- kaicianflone 9mo agoIt is tool use with natural language search queries but going down a layer they are searched on a vector DB, very similar to RAG. Essentially Google RankBrain is the very far ancestor to RAG before compute and scaling.
- thunky 9mo agoIt's RAG via tool use, where the storage and retreival method is an implementation detail. I'm not a huge fan of the term RAG though because if you squint almost all tool use could be considered RAG. But if you stick with RAG being a form of "knowledge search" then I think Google search easily fits.
- PlatoIsADisease 9mo agoCant you make thresholds higher? Hmm... I guess not, you might want all that data. Super interesting topic. Learning a lot.
- plingamp 9mo agoSpecifically when the document number reaches around 10k+, a phenomenon called "Semantic Collapse" occurs. https://dho.stanford.edu/wp-content/uploads/Legal_RAG_Hallucinations.pdf https://dho.stanford.edu/wp-content/uploads/Legal_RAG_Halluc...
- yjftsjthsd-h 9mo agoSo you're telling me rampancy ( https://www.halopedia.org/Rampancy https://www.halopedia.org/Rampancy ) is real.
- zophi 9mo ago> Specifically when the document number reaches around 10k+ Where are you getting this? just read the paper and not seeing it -- interested to learn more