stummjr

6 ms·

1. 31.▲
   by stummjr 11y ago

   What do you mean by "data like that"? Metadata in Microdata format? Btw, nice to hear your own experience here. :)
2. 32.▲
   by stummjr 11y ago

   You're not alone on that! :)
3. 33.▲
   by stummjr 11y ago

   There is an idea to make Scrapy support Spiders written in other languages[1]. It has been featured on the Google Summer of Code 2015[2]. [1] https://github.com/scrapy/scrapy/issues/1125 [2] http:/&#x2F
4. 34.▲
   by stummjr 11y ago

   1) detect pages that had changed since the last crawl, to avoid recrawling pages that hadn't changed? You could use the deltafetch[1] middleware. It ignores requests to pages with items extracted in previous crawls. 2) detect pages tha
5. 35.▲
   by stummjr 11y ago

   Hey, not sure if I understood what you mean. Did you mean: 1) detect pages that had changed since the last crawl, to avoid recrawling pages that hadn't changed? 2) detect pages that have changed their structure, breaking down the Spide
6. 36.▲
   by stummjr 11y ago

   Hey, author here! Feel free to ask any questions you have.
7. 37.▲
   Scrapy Tips from the Pros, Part 1(blog.scrapinghub.com)

   5 points by stummjr 11y ago|0 comments
8. 38.▲
   by stummjr 17y ago

   I think Aikido is a very good option, not only to programmers, but to all the people. It's a martial art which is meant to preserve the integrity of both players. Both mental and body health are the main concerns of this martial art.