3 ms·The robots.txt file for HN suggests a Crawl-Delay value of 30 seconds.by mvanveen 14y agoThe robots.txt file for HN suggests a Crawl-Delay value of 30 seconds.