4 ms·
> The focus on the top 10 in vector search is a product of wanting to prove value over keyword search I'm surprised to see less mention of the use of vector se
by IKantRead 3y ago
> The focus on the top 10 in vector search is a product of wanting to prove value over keyword search
I'm surprised to see less mention of the use of vector search in RAG. The reason top 10 (or less) is so important in RAG is that you only have so much context to work with (and even in large context models, you still would prefer to minimize the total amount of context you're sending the model).
Everyone I know working seriously on vector search is using it to plug into a prompt for an LLM. For this use case top 10 is a fairly important metric.