3 ms·Does Octopart honor robots.txt on Digi-Key's site as it crawls it?by anatoly 19y agoDoes Octopart honor robots.txt on Digi-Key's site as it crawls it?