3 ms·
Most spiders implement a maximum depth in their search though. So you'd really just get an inefficient crawl, not an infinite one.
by anarcticpuffin 17y ago
Most spiders implement a maximum depth in their search though. So you'd really just get an inefficient crawl, not an infinite one.
- pedalpete 17y agoOf course, using Google as a seed list more than crawling only google. Not sure why I didn't think of that.