2 ms·
I definitely was thinking about something like this for PaperMatch itself. Where anyone can pull a docker image and search through the articles locally! Do you
by Quizzical4230 2y ago
I definitely was thinking about something like this for PaperMatch itself. Where anyone can pull a docker image and search through the articles locally! Do you think this idea is worthwhile pursuing?
- bubaumba 2y agoAbsolutely worth doing. Here is interesting related video, local RAG: https://www.youtube.com/watch?v=bq1Plo2RhYI https://www.youtube.com/watch?v=bq1Plo2RhYI I'm not an expert, but I'll do it for learning. Then open source if it works. As far as I understand this approach requires a vector database and LLM which doesn't have to be big. Technically it can be implemented as local web server. Should be easy to use, just type and get a sorted by relevance list.
- Quizzical4230 2y agoPerfect! Although, atm I am only using retrieval without any LLM involved. Might try integrating if it significantly improves UX without compromising speeds.