3 ms·
New modern web crawling tool
- XORbit01 3y agowebpalm is a command-line tool that traverses a website and generates a tree of all the webpages and their links, additionally it can dump data from the body of the pages using regular expressions then store the result in a file.
- akhayam 3y agoSounds cool, but how is this different from Colly: https://github.com/gocolly/colly https://github.com/gocolly/colly?
- XORbit01 3y agocolly have 103 contribs webpalm have 1 and only sigma contrib
- DavidNielsen 3y agoSomething proudly declaring itself powered by Malwarize, that sounds comforting.