9 ms·Aaron Swartz' robots.txt file6 points by hornbaker 14y agozoowar 14y agoOK this is getting ridiculous.imwhimsical 14y agoAgreed.