3 ms·
> Vector search+context stuffing (RAG) is clearly a hack that doesn't resemble how we actually think or do things in reality. Its actually a very close model o
by dragonwriter 3y ago
> Vector search+context stuffing (RAG) is clearly a hack that doesn't resemble how we actually think or do things in reality.
Its actually a very close model of how people use external data sources to supplement thought in reality. Its a hack, but it is very much the same hack (indexing external data, and looking up and stuffing some in our brain temporarily at need) that humans have used forever (with a novel indexing method.)
Its not (intentionally, at least) a model of anything that happens inside the human brain, but what humans do in reality extends beyond what happens inside the brain.
- vorticalbox 3y agoI've noticed this as I've gotten older, I have started to remember "where" to find information rather than remembering it. I end up with a lot of book marks as a result.
- _boffin_ 3y agoI have severe ADHD and have never been good at tests due to this issue right here. I’m now a professional and I carry my books, notes, articles, papers, etc… with me everywhere via my iPad and margin notes. I’ve found, since a young age that knowing where to find the information I need vs memorization is how my brain works best. Wish it was the opposite though.