4 ms·
Be careful when using this - violates the CL TOS[0] and they've been known to sue people who scrape their system[1]. Relevant excerpt from TOS: “Any copying,
by mipmap04 11y ago
Be careful when using this - violates the CL TOS[0] and they've been known to sue people who scrape their system[1].
Relevant excerpt from TOS:
“Any copying, aggregation, display, distribution, performance or derivative use of Craigslist or any content posted on Craigslist whether done directly or through intermediaries (including but not limited to by means of spiders, robots, crawlers, scrapers, framing, iframes or RSS feeds) is prohibited.”
[0] http://www.craigslist.org/about/terms.of.use http://www.craigslist.org/about/terms.of.use
[1] http://arstechnica.com/tech-policy/2012/07/craigslist-sues-padmapper-for-copyright-infringement/ http://arstechnica.com/tech-policy/2012/07/craigslist-sues-p...
- etatarkin 11y agoYou are right. But this example only for research purposes, and gathered data will only stored for short time and without publication, personal information of users are not gathered. And CL team allow any user-agent crawl it by http://www.craigslist.org/robots.txt http://www.craigslist.org/robots.txt If some body want to use this scraper he must ask about it CL team. Sorry for my poor English.