3 ms·

And still one thing .. if you want to ask the site owner for permissions, why not ask them to produce some specific xml file for you?

• akkartik 19y ago
  Because granting permission is easy. Why would they go to more effort than that for random people?
  • ivan 19y ago
    Why thousands of job sites produce custom xml output for simplyhired or indeed ??
    • imsteve 19y ago
      They like buzzwords?
• marketer 19y ago
  I think this is the best way to go. There's no reason that you should be scraping HTML from sites, when there might be a nice xml feed available. For instance, pricegrabber will only index your site if they have prices in XML.