2 ms·Don't forget to set a good user-agent header and follow the rules set forth by robots.txt!by emilv 14y agoDon't forget to set a good user-agent header and follow the rules set forth by robots.txt!