3 ms·
> is there a way for bots (in particular, mechanize in perl/python) to also download those files? The point was mostly that if it is not downloaded, then it's
by oelmekki 14y ago
> is there a way for bots (in particular, mechanize in perl/python) to also download those files?
The point was mostly that if it is not downloaded, then it's a bot (or any non-browser getter, at least), not that it's not a bot if it does.
Or maybe you were asking for a way to avoid bot detection ? :)