4 ms·wouldn't a crawler be a "web crawler"? It doesn't actually handle the search engine aspects.by nkristoffersen 6y agowouldn't a crawler be a "web crawler"? It doesn't actually handle the search engine aspects.