4 ms·
For a RAG project for a client with a lot of PDFs and Powerpoints with images, I used ColPali a year ago. I see the provider ColiVara is still online but it see
by vinzenzu 4mo ago
For a RAG project for a client with a lot of PDFs and Powerpoints with images, I used ColPali a year ago. I see the provider ColiVara is still online but it seems to have fizzled out.
Retrieving based on text and then giving the generation model the image instead is much smarter than retrieving based on image. Image-based retrieval is slow and expensive.
Same with giving the model an image vs a structured representation of it.
- throwaw12 4mo ago> For a RAG project for a client with a lot of PDFs and Powerpoints with images, I used ColPali a year ago How was the accuracy compared to pre-parsing the image and doing search in the text?
- vinzenzu 4mo agoLeaps and bounds better! I don't think I benchmarked it. But the experience was that it was able to find small details in PDFs, in technical diagrams, and this was really not captured well at all with OCR. In general, OCR I think should be used more as an add-on to retrieve data, not given to the generation model itself. Similar to retrieving based off a text description and then giving the generation model the image.