3 ms·

Formalizing the Robots Exclusion Protocol Specification

10 points by pbowyer 7y ago

egypturnash 7y ago
actual RFC proposal if anyone is curious: https://datatracker.ietf.org/doc/draft-rep-wg-topic/ https://datatracker.ietf.org/doc/draft-rep-wg-topic/