3 ms·
I think it works well when it's not a blob of text. One issue is that most of them are really long-winded. For example, if the answer can be nouns, just give
by binarymax 3y ago
I think it works well when it's not a blob of text. One issue is that most of them are really long-winded. For example, if the answer can be nouns, just give me the list of nouns instead of a full sentence or paragraph.
Take for example this search: https://search.brave.com/search?q=what+are+the+captain+america+movies%3F&source=web https://search.brave.com/search?q=what+are+the+captain+ameri...
Why the paragraph? Just give me a bulleted list! It's hard to read and kinda annoying.
Another issue for me is trust. Web search is oft polluted with web spam (this is not new). Mentally, one can see a URL and skip a site that doesn't have strong authority. So now in RAG, I either need to trust the answer, or I need to look at the embedded citation and find the document and then see if it's trustworthy. This adds friction.
This is also not unique to web search. Private search can also have poor relevance - do I know the LLM is being given the best context? Or is it getting bad context and hallucinating? I need to look at the results to be sure anyway.
I think when used in appropriate ways it can be good. But the experience of "summarize these 10 results for me" might not be the best for every query.
- DebtDeflation 3y agoYou're referring to what in the NLP subfield of Question Answering Systems would be known as a "factoid question". Historically, things like knowledge graphs and RDF triple stores would be used for answering these types of questions. I'm still not sold on the idea that an LLM is the answer to all QA/Chat problems and this is one example.