3 ms·
what do you think about ColBERT? doing embedding on every token feels wrong in ways i can't articulate - is there a time to use it and not use it, or is it the
by swyx 2y ago
what do you think about ColBERT? doing embedding on every token feels wrong in ways i can't articulate - is there a time to use it and not use it, or is it the one retrieval technique to rule them all?
- jeffchuber 2y agoColbert is great! - Check out https://github.com/AnswerDotAI/RAGatouille https://github.com/AnswerDotAI/RAGatouille by the excellent https://x.com/bclavie https://x.com/bclavie Relatedly ColPali (https://arxiv.org/abs/2407.01449 https://arxiv.org/abs/2407.01449) is gaining a ton of steam in the IR community. In general we are skeptical of silver bullets in retrieval.