3 ms·
What is a spider in this context?
by euparkeria 2y ago
What is a spider in this context?
- clarkrinker 2y agoOld name for a web crawler / search indexer
- dmd 2y agohttps://en.wikipedia.org/wiki/Web_crawler https://en.wikipedia.org/wiki/Web_crawler
- deleted 2y ago[deleted]
- cosmojg 2y ago> A Web crawler, sometimes called a spider or spiderbot and often shortened to crawler, is an Internet bot that systematically browses the World Wide Web and that is typically operated by search engines for the purpose of Web indexing (web spidering). See: https://en.wikipedia.org/wiki/Web_crawler https://en.wikipedia.org/wiki/Web_crawler