3 ms·

This is nothing new. Google built an entire business on scraping and indexing content, and then aggressively blocks anyone from scraping that index. If you thi

This is nothing new. Google built an entire business on scraping and indexing content, and then aggressively blocks anyone from scraping that index. If you think about it, it's kind of weird that there is no official API for Google search. They've got one for all their other products.

AlienRobot 3y ago
Google: if your website is full of ads, we'll downrank you. >:( Also Google: we automatically enabled vignette interstitials on your website. :)
- sidewndr46 3y ago
  Google: if your website is slow to load we'll downrank you Also Google: builds tool that claims you load a bunch of JS & CSS from their ad network, thus making your own website slow
  - ipaddr 3y ago
    If you are fast to load we will present a slower amp link instead
  - rmbyrro 3y ago
    Don't forget bloated Google Analytics and ad tracking garbage.
CobrastanJorji 3y ago
The Google Search API was one of the first big Web 2.0 examples of an API. Basically every big colorful "how to do APIs" or "learn JavaScript" book in Barnes and Nobles used the Google Search API as their main example of what an API was and how useful it was until 2011 or so, when Google started turning it down.