3 ms·
I’ve build something that uses Solr for indexing and some old ideas I had about crawling with Grub back in the day. The solution uses either the browser or a Se
by kordlessagain 5y ago
I’ve build something that uses Solr for indexing and some old ideas I had about crawling with Grub back in the day. The solution uses either the browser or a Selinum box to image the website and OCR to extract the text and bounding boxes. It will save the image in Google cloud and provides full text search and other Solr facet functionality for ranking. It’s not designed to crawl recursively, but it allows users to save both URLs and images they want to search for later. Menus work great and with some more work in extracting images from pages with OpenCV, it should allow for searching labels coming in from machine learning models. Happy to share with who ever wants to take a look.
The repo for deploying Solr on Google Cloud is here: https://gitHub.com/kordless/grub-2.0 https://gitHub.com/kordless/grub-2.0