4 ms·
I don't, now that you mention that it's entirely possible that my crawling scheme doesn't work anymore. The beta was 100% free and I didn't pay much attention
by dljsjr 13y ago
I don't, now that you mention that it's entirely possible that my crawling scheme doesn't work anymore. The beta was 100% free and I didn't pay much attention to what changed when the beta ended.
- qhoxie 13y agoWe still allow this. You are just more limited in how frequently you can do an on-demand crawl with the free plan versus a paid plan. You can also ping our API to update a specific URL immediately, which is really helpful is cases like this.