Here here. The right tool for the right job. And I can't think of a "righter" tool for this kind of job. Edit - not picking on you, but given the quality and e

Here here. The right tool for the right job. And I can't think of a "righter" tool for this kind of job. Edit - not picking on you, but given the quality and ecosystem of libraries and ancillary tools for scrapy, I don't even consider alternatives at this point. Good on anyone who does it to learn but for actual workloads I won't consider anything else.