4 ms·
El5 me what is rerank model? Why 4k context window size is considered large?
by bigcat12345678 3y ago
El5 me what is rerank model?
Why 4k context window size is considered large?
- razodactyl 3y agoImagine you have 100 documents in a database and you "query" the documents and return 20 candidate results. Similarity gave you 20 results but Re-ranking sorted those results further providing relevance. That 4K is per document. Edit: With sorted relevance, you can drop the lower scoring documents according to the model's confidence that the information in the subset is adequate to answer the query.
- bigcat12345678 3y ago20 results, each have 4k snippet, feed to this ranking model, ranking model produces a score based on query Is this a correct understanding?