3 ms·
I think it depends on the application. Though I asked the question below as ffumarola said it was 'bad practice'. Why scraping is any worse than crawling is be
by pedalpete 16y ago
I think it depends on the application. Though I asked the question below as ffumarola said it was 'bad practice'.
Why scraping is any worse than crawling is beyond me. But again, it depends on the application. I built a concert search engine which scraped data from multiple sites. It is my understanding that all the concert sites are getting a bunch of data from published apis and then topping up with scraped data.