I didn't say it was perfectly accurate, just that it was the best. So your argument is that a better way to check this is to crawl the entire web looking for l

I didn't say it was perfectly accurate, just that it was the best. So your argument is that a better way to check this is to crawl the entire web looking for links to a resource to determine if it was meant to be publicly accessible?