2 ms·
You’re right. HN asks for a crawl delay of 30 seconds. So if you want to be a good citizen and you have a thousand comments, that’d take about 8 hours. Not too
by sillysaurusx 4mo ago
You’re right. HN asks for a crawl delay of 30 seconds. So if you want to be a good citizen and you have a thousand comments, that’d take about 8 hours. Not too bad.
You can do it by including your “user” cookie. (You can get that by examining the cookie store via the browser.)