4 ms·
New Modern Fast Crawler
- XORbit01 3y agowebpalm is a command-line tool that traverses a website and generates a tree of all the webpages and their links, additionally it can dump data from the body of the pages using regular expressions then store the result in a file.