3 ms·
It might be possible to kill a naive crawler with some infinitely-spiralling link web. However, most modern crawlers are built with this in mind and will stop
by RKoutnik 11y ago
It might be possible to kill a naive crawler with some infinitely-spiralling link web. However, most modern crawlers are built with this in mind and will stop after a certain recursive level is met.