3 ms·
Yes, there's lots of folks doing this and currently it looks like combining results from an LLM based index and a standard text retrieval indexes (e.g. using BM
by ordersofmag 3y ago
Yes, there's lots of folks doing this and currently it looks like combining results from an LLM based index and a standard text retrieval indexes (e.g. using BM25) may beat either alone. Note that you can add and search LLM derived vectors from within Elasticsearch: look up 'dense vector search' in the docs. Check out the Haystack conference next week for lots of discussion of current practices: https://haystackconf.com/2023/ https://haystackconf.com/2023/
- JPKab 3y agoThanks! I've looked at haystack a little bit and was wondering how involved it would be to set up for a research spike.