2 ms·
If you're willing to veer off from C# there's a great framework in Python called Scrapy [0], it's fast and easy to pick up. You could crawl and save the results
by mmariani 14y ago
If you're willing to veer off from C# there's a great framework in Python called Scrapy [0], it's fast and easy to pick up. You could crawl and save the results in your database with Scrapy, and get them back with your C# backend.
[0] http://scrapy.org/ http://scrapy.org/
- gurpreet42 14y agoI can switch to any platform, provided that would be best one. I will check this framework and try to create a demo application so that i can get better idea. There are many companies that use web crawling. Are they using Pyton or something other ?