4 ms·
Very interesting approach. For those interested in an alternate method that doesn't depend on a LLM, check out this article: https://neuml.hashnode.dev/build-r
by dmezzetti 3y ago
Very interesting approach.
For those interested in an alternate method that doesn't depend on a LLM, check out this article: https://neuml.hashnode.dev/build-rag-pipelines-with-txtai https://neuml.hashnode.dev/build-rag-pipelines-with-txtai
Disclaimer: I'm the primary author of txtai.
- leobg 3y agoAre you affiliated with txtai?
- jerpint 3y agoLooks like it’s just RAG? The paper is proposing an alternative to RAG due to its shortcomings
- dmezzetti 3y agoIt's RAG and a method that identifies citations from the context.
- bugglebeetle 3y agoThe shortcoming of most RAG-based approaches is the assumption that the question resembles the answer in a way that also jives with the embeddings model. Thus far, I’ve not seen strong evidence (or in my testing) that this is true or works well, but at least citation allows for better assessment. The problem seems to be that we don’t have a good feedback loop for ranking RAG retrieval, as we have for LLMs with things like DPO.
- whakim 3y ago100%. This is why RAG and "classical search" will converge for non-trivial use cases. The folks who are doing RAG well still rely on many tried-and-true tricks of the trade: combining semantic search with keyword-based search, using graphs, doing re-ranking, etc. etc. Yet most discussions of RAG on the internet seem to promise consistently awesome query output by just jamming together some embeddings and an LLM, which doesn't pan out in practice.
- dang 3y agoCan you please stop posting so promotionally on HN? If you read https://news.ycombinator.com/newsguidelines.html https://news.ycombinator.com/newsguidelines.html, you'll see it's against the site guidelines.
- dmezzetti 3y agoYou got it and I appreciate you asking kindly. I will say though that hopefully you'll consider applying that policy equally to all. Because many VC-backed and large companies basically post press releases and they trend without issue. I'm a single person open-source project. But it's your site, I'll respect your request and not post moving forward.
- dang 3y agoI certainly hope we apply things equally! But there are inevitably cases we miss because we don't see everything that gets posted to HN; we largely rely on users to point us to those.
- dmezzetti 3y agoI'm sure it's a tough challenge. And that's just keeping up with the people who are being open and honest about their product/project associations, never mind the others. I appreciate all you do in keeping the site up and running along with the dedication to ensuring it has high-quality content.
- mountainriver 3y agoI found what he posted relevant and useful, not sure what the issue is
- dang 3y agoOh yes, the GP comment was fine in isolation. The issue has to do with posting similar things too often. If an account is using HN primarily for promotion, that's not in the intended spirit of the site. This is in the site guidelines: https://news.ycombinator.com/newsguidelines.html https://news.ycombinator.com/newsguidelines.html.