3 ms·
A better way would be to ask the LLM to generate keywords (or queries). And then use old school techniques to find a set of documents, and then filter those usi
by amelius 2y ago
A better way would be to ask the LLM to generate keywords (or queries). And then use old school techniques to find a set of documents, and then filter those using another LLM.
- brookst 2y agoHow is that better than embeddings? You’re using embeddings to get a finite list of keywords, throwing out the extra benefits of embeddings (support for every human language, for instance), using a conventional index, and then going back to embeddings space for the final LLM? That whole thing can be simplified to: compute and store embeddings for docs, compute embeddings for query, find most similar docs.
- osmarks 2y agohttps://arxiv.org/abs/2212.10496 https://arxiv.org/abs/2212.10496