So if I understand it correct Crawlab is another simple easy to use admin for managing web crawlers, one still needs to use scrapy or write their own crawlers.

So if I understand it correct Crawlab is another simple easy to use admin for managing web crawlers, one still needs to use scrapy or write their own crawlers. It should be similar to the admin tool I mentioned in my earlier comment and at: https://github.com/topics/scrapy-ui https://github.com/topics/scrapy-ui https://github.com/topics/scrapyd-ui https://github.com/topics/scrapyd-ui