4 ms·
On the tool side: there must be some services that do web scrapping and diffing periodically. Of course with additional filtering like diff only content from sp
by hawski 4y ago
On the tool side: there must be some services that do web scrapping and diffing periodically. Of course with additional filtering like diff only content from specified selector, ignore this, ignore that. Can someone recommend anything like that? Bonus points if it's just a thing one can run locally.
- bspammer 4y agoNot 100% what you’re asking for but git scraping is a pretty cool technique. The idea is you set up a bot to scrape the data and commit to a git repository periodically. This can be done completely for free with no maintenance using GitHub Actions, for example. https://simonwillison.net/2020/Oct/9/git-scraping/ https://simonwillison.net/2020/Oct/9/git-scraping/
- 1123581321 4y agoIt’s a hosted service, but Wachete has been watching some pages for me for years. For local, with more control, try scripting Selenium or Phantomjs with Python.