2 ms·
Interesting, but I'm confused. Why does this list not include the `robots.txt` (rfc9309)?
by thegarliccheese 3y ago
Interesting, but I'm confused. Why does this list not include the `robots.txt` (rfc9309)?
- mrgaro 3y agoI guess these uris are all under /.well-known/ path, which robots.yxt predates. I didn't know there are this kind of organized list of these.
- thegarliccheese 3y agoOh, well that makes sense. I couldn't connect the dot's as I haven't heard of most of these. Thanks!