2 ms·
Yeah, a "spider this page with depth X" would be a neat addition. Edit: Though the way it works as a sort of proxy, it seems like you could combine it with som
by tyingq 5y ago
Yeah, a "spider this page with depth X" would be a neat addition.
Edit: Though the way it works as a sort of proxy, it seems like you could combine it with something like this, and it would just work: https://github.com/naoak/chrome-site-spider https://github.com/naoak/chrome-site-spider
- graderjs 5y agoCool thanks for that, indeed it seems like it would work.
- thricegr8 5y agoWould something like this work for single-page applications? Given that most applications today are built entirely through the DOM, would regex matching on embedded scripts be that useful? I've actually started thinking about how to build a spidering/scraping tool that extracts links/JS, etc from an SPA but would rather not reinvent the wheel if possible.