2 ms·
I’ve found imaging the page and doing OCR on the image is quite good for text extraction. Many pages on the Internet render with JavaScript, which means BS may
by kordlessagain 5y ago
I’ve found imaging the page and doing OCR on the image is quite good for text extraction. Many pages on the Internet render with JavaScript, which means BS may not see the text in the DOM.
Here is the code to do some of that: https://github.com/kordless/grub-2.0 https://github.com/kordless/grub-2.0
Link extraction is ignored, but could be done with BS on the rendering of the DOM.