3 ms·

Try to crawl amazon.

• fastball 6y ago
  Right, but that’s not really anti-search-engine, that’s anti-people-who-want-our-actual-data. Like I said in another comment, if you’re someone that just wants to surface Amazon results they love you. It’s the people that want to take advantage of amazon data in some other way they’re trying to stop.