3 ms·
Very small amount of sourcecode: Under 20k by my count. Are they outsourcing the actual crawl to a different tool?
by internetter 2y ago
Very small amount of sourcecode: Under 20k by my count. Are they outsourcing the actual crawl to a different tool?
- mistaken 2y agoIt seems to contain the crawler: https://github.com/janreges/siteone-crawler/blob/main/src/Crawler/Crawler.php https://github.com/janreges/siteone-crawler/blob/main/src/Cr...
- janreges 2y agoSiteOne Crawler offers 2 open-source tools: 1) command-line version (which is the core of the crawler itself): https://github.com/janreges/siteone-crawler https://github.com/janreges/siteone-crawler 2) a graphical application for Win/macOS/Linux, which is just a wrapper over the command-line version and displays the output from it through Xterm: https://github.com/janreges/siteone-crawler-gui https://github.com/janreges/siteone-crawler-gui