4 ms·
The headline seems a bit sensationalized. From what I can tell Ancestry has a webcrawler that respects robots.txt files, crawls publically available webpages,
by CSMastermind 2y ago
The headline seems a bit sensationalized.
From what I can tell Ancestry has a webcrawler that respects robots.txt files, crawls publically available webpages, and they offer search engine results that link to the original page.
This seems exactly like what Google and every other search engine does?
- xhkkffbf 2y agoExactly. These sites are kind of specialized search engines that work with lots of public records. Using the word "stealing" for what's already public information doesn't seem right. It's not even like we're talking about copyrightable text. These are facts.