2 ms·
As long as they respect the robots.txt, and aren't hitting the site constantly, there shouldn't be a problem technology-wise. Now, whether this business wants
by chiph 14y ago
As long as they respect the robots.txt, and aren't hitting the site constantly, there shouldn't be a problem technology-wise.
Now, whether this business wants a potential competitor doing this, that's a different story.