3 ms·
If you mean compared to an online service, they usually have to restrict how many sites you crawl, how often you can crawl and will have trouble with local and
by seanwilson 9y ago
If you mean compared to an online service, they usually have to restrict how many sites you crawl, how often you can crawl and will have trouble with local and private sites. Google Webmaster Tools can take days to give you updates on issues for example and you have to push your changes live to get feedback.
So as a Chrome extension, you can crawl your local development sites, staging sites, sites on private networks and you can immediately recrawl pages again whenever you want to confirm you've fixed issues. Many developers need to work on multiple sites as well.
- chatmasta 9y agoOh, got it. I thought your chrome extension was doing the actual crawling serverside. This makes sense then. I haven’t tried it out, but if it works on localhost, that’s awesome.
- seanwilson 9y agoYes, the crawling happens from your own machine. I'll need to make this more obvious somehow.