Absolutely spot-on. It makes me think of my own experience. I've worked for a few niche search engines. Some sites have APIs available so that you don't have t

Absolutely spot-on. It makes me think of my own experience. I've worked for a few niche search engines. Some sites have APIs available so that you don't have to scrape their data. But often times, since we were already used to scraping sites, we wouldn't even notice that an API was available. In a few number of cases, an API _was_ available, but it was more restrictive or complicated than it was for us to just scrape a page. That's not to say that we never used them, because we certainly did. Just that we often were never aware that they were an option since they were not very common in our cases.