3 ms·
Pretty interesting. Wrote a web scraping api you can paste in to your browser and download results last year but took it down to work on another project. You ca
by curiously 11y ago
Pretty interesting. Wrote a web scraping api you can paste in to your browser and download results last year but took it down to work on another project. You can take look at what a url could look like.
https://web.archive.org/web/20140420162639/http://scrape.ly/ https://web.archive.org/web/20140420162639/http://scrape.ly/
For example if you wanted the profile of authors of today's stories
http://scrape.ly/s/{http://news.combination.com}
{'ueoma87'}*{'next':'Next Page'}{'karma':'331',
'username':'ueoma87'}
Would've returned all the profiles of each story's author today and yesterday and so on.
- owainlewis 11y agoThanks. This looks really interesting. I may well borrow some ideas ; )