Thanks for your comment. This article is a tutorial that tell people how to build a distributed system with docker and celry easily. Scrapy is good framework f

Thanks for your comment. This article is a tutorial that tell people how to build a distributed system with docker and celry easily. Scrapy is good framework for crawler. I used it before, but it doesn't have some features I want. Writing a brand new one is easier for me. Of course , I am open to compare the special performances of these two crawlers. Welcome to have a discuss more technical details here. Thanks for your comment again.