4 ms·
The pause is 24 hours. Once running it wont stop till there are urls with some pattern to crawl, there is also a limit to stop when enough pages didnt have an a
by visox 5y ago
The pause is 24 hours. Once running it wont stop till there are urls with some pattern to crawl, there is also a limit to stop when enough pages didnt have an app
- the_parzival 5y agoThat's neat. Great project
- visox 5y agothx :) but i guess its not high quality enough.
- the_parzival 5y agoLooks great to me. Why do you think it is not of high quality?