> Their thinking was that the vast majority of traffic is coming from google, and it wasn't worth it to have multiple also-ran search engines crawling their sit

> Their thinking was that the vast majority of traffic is coming from google, and it wasn't worth it to have multiple also-ran search engines crawling their site frequently. There's a case to be made that search engines are actually a natural monopoly. The other case to be made that people doing this sort of decisions should loose their jobs.