4 ms·
This is sortof true for search engines, but HN is hit by a myriad of bots and scrapers non stop. There is no telling what they will choose to do with the data.
by LinuxBender 8y ago
This is sortof true for search engines, but HN is hit by a myriad of bots and scrapers non stop. There is no telling what they will choose to do with the data. I still get hits on my domains for URL's that ceased to exist 20 years ago and that have no internet references to them.