3 ms·
I feel like the majority of queries won't benefit from LLM responses and a huge chunk that do could be easily pre-computed and don't need to use the model on ea
by ren_engineer 4y ago
I feel like the majority of queries won't benefit from LLM responses and a huge chunk that do could be easily pre-computed and don't need to use the model on each search, pretty much all queries about historical figures and events just need to be summarized once.
- fnordpiglet 4y agoI think questions will be different once we can pose human questions rather than weird cryptic search terms to trick an information retrieval system into finding text blobs that might be relevant. For instance instead of searching for “George Washington” I could ask “What did George Washington write in his journals about the continental congress?” I wouldn’t expect this answer to be precomputed. FYI ChatGPT answered that he didn’t keep journals about this, which I know to be true despite being a prolific journal keeper. It answered he did however write letters and they were about his personal affairs but also his inspiration about American independence d. I then asked it who he wrote to. It provided a bunch of folks, including General Gates, which is all correct. I then asked it details on what Gates and Washington discussed. Etc. The value isn’t that it can summarize a biography of George Washington. The value is I can get a direct answer to my direct questions, then refine my questions to the depth and subjects I’m interested in. Information retrieval systems can just give me potentially relevant text blobs I need to sift, parse, and analyze with iterative queries until I give up in disgust at the state of SEO.