3 ms·
Their robots.txt doesn't indicate that, but the page has a noindex meta tag so yeah.
by tiborsaas 4y ago
Their robots.txt doesn't indicate that, but the page has a noindex meta tag so yeah.
- jan_Inkepa 4y agoHuh - a random post on a different blog seems to have no mention of robots - https://astralcodexten.substack.com/p/highlights-from-the-comments-on-the-909 https://astralcodexten.substack.com/p/highlights-from-the-co... . Maybe it's a per blog setting?