3 ms·
Not sure what do you use to scrape, but I can recommend newspaper to extract text. I contributed a while ago and it was pretty solid. https://github.com/codel
by ecesena 10y ago
Not sure what do you use to scrape, but I can recommend newspaper to extract text.
I contributed a while ago and it was pretty solid.
https://github.com/codelucas/newspaper https://github.com/codelucas/newspaper
- bexp 10y agothanks will try that
- sohkamyung 10y agoThanks for that. The Newspaper demo site seems to show it working quite well on the news sites I usually browse.