3 ms·

Too bad this will probably be banned for eating up a lot of CL bandwidth. See prior hack called listpic: http://downloadsquad.switched.com/2007/06/08/jim-buckme

by hung 15y ago

Too bad this will probably be banned for eating up a lot of CL bandwidth. See prior hack called listpic: http://downloadsquad.switched.com/2007/06/08/jim-buckmeister-qanda-why-craigslist-banned-listpic/ http://downloadsquad.switched.com/2007/06/08/jim-buckmeister...

progolferyo 15y ago
We are using the 3taps API, not parsing Craigslist directly. They aggregate all this data for us.
SeoxyS 15y ago
You'd be surprised, but our entire service does not make a single request to the craigslist servers. We get the craigslist postings from the 3taps API, which themselves scrape Google Caches to import that data. The images are typically hosted on services like imageshack or flickr. We store everything in our own database and keep track of our own version of the data, which we stream from the 3taps firehose.
- hung 15y ago
  O RLY? http://i.imgur.com/ccBEs.jpg http://i.imgur.com/ccBEs.jpg
  - SeoxyS 15y ago
    Right. Fair enough. But, even then, the requests come from the client browser, rather than our server, which is much less likely to be a problem to CL.