4 ms·
Curious: what does "/-/" it their robots.txt[1] do? User-agent: * Disallow: /-/ Disallow: /account/ 1: http://www.quip.com/robots.txt http://www.q
by jboynyc 13y ago
Curious: what does "/-/" it their robots.txt[1] do?
User-agent: *
Disallow: /-/
Disallow: /account/
1: http://www.quip.com/robots.txt http://www.quip.com/robots.txt
- casey 13y agoThat's just where we put the ajax paths to keep a cleaner URL space
- jboynyc 13y agoInteresting. However, it seems to block bots entirely: http://web.archive.org/web/*/http://www.quip.com http://web.archive.org/web/*/http://www.quip.com
- finiteloop 13y agoWe just opened up the file at launch... Maybe caching or latency?
- TheZenPsycho 13y agoInforms search engines not to index the http://www.quip.com/-/ http://www.quip.com/-/ directory.
- jboynyc 13y agoOK, cheers. I assumed it must be some kind of regexp because according to the Web Archive (see my comment below) the entire domain is disallowed.