3 ms·

Awesome! This is ridiculously better than Craigslist. A quick heads-up: Using the parameters provided in the HN link, a number of the listings are dead, includ

Awesome! This is ridiculously better than Craigslist. A quick heads-up: Using the parameters provided in the HN link, a number of the listings are dead, including: http://www.cars.com/go/search/detail.jsp?listingId=86102429 http://www.cars.com/go/search/detail.jsp?listingId=86102429 http://www.web2carz.com/68535832/2008/acura/tl/used-cars/for-sale?w2caf=c696edb0ff314577 http://www.web2carz.com/68535832/2008/acura/tl/used-cars/for... http://www.web2carz.com/68335253/2005/acura/tl/used-cars/for-sale?w2caf=c696edb0ff314577 http://www.web2carz.com/68335253/2005/acura/tl/used-cars/for... Will these be purged periodically?

kapgoals 14y ago
Well, our scrapers take about 2-3 days to complete a loop, so it is indeed possible for you to find dead links here and there...It shouldn't be a large percentage though. Fortunately, we will have API's from two major source sites within the next few weeks, and that should greatly reduce our dependence on scraping.