21 ms·
You expect Google, Bing and DDG to honor requests not to be indexed, don't you? How is this different? And what Craigslist does or doesn't do to make money sho
by eli 14y ago
You expect Google, Bing and DDG to honor requests not to be indexed, don't you? How is this different?
And what Craigslist does or doesn't do to make money shouldn't change what you're allowed to do with their content.
- ericd 14y agoPadMapper obeys robots.txt's, for the record. Also, it doesn't repost their content, it reposts facts about the content, which is a pretty key difference. They've had an informal amnesty for services using their stuff for a long time, Craig has stated that they're OK with services that interface with them as long as they don't use many server resources, but they recently updated their TOU and started sending out huge waves of C&D's a few weeks ago, based on my talking with people.