I haven't used your scraper, I worked with scrapy. I found debugging as well as command and control to be challenging. Colly was a big step up. For reference I

I haven't used your scraper, I worked with scrapy. I found debugging as well as command and control to be challenging. Colly was a big step up. For reference I am primarily a Golang programmer so I find weakly typed tools frustrating.