2 ms·The Allow: directive was an extension to robots.txt added later.by xnx 3y agoThe Allow: directive was an extension to robots.txt added later.