5 ms·
There are multiple internal tools I use at work (JIRA, our ticketing system, our code review tool) that won't work because of this issue. In the meantime, I've
by alttab 13y ago
There are multiple internal tools I use at work (JIRA, our ticketing system, our code review tool) that won't work because of this issue.
In the meantime, I've written Tampermonkey scripts that will scrape and embedd multiple pages all hack-like, but at least I get a good CSV of the data I need.
To me, the value in this tool is the user interface for creating the scrape logic. If this ran as an embeddable JS app, that you could place inside any page and utilize local storage, you could scrape these dynamic sites by viewing the page first, and still get all of the cool gadetry provided by this tool.
In essence, the value of this tool could be built as a bookmarklet. THAT SIR - I would use every, single, day.
- stedaniels 13y agoWhy would scrape JIRA when they have a perfectly workable API?
- lepht 13y agoWhile their APIs are nice, they require separate permissions and having access to them isn't always a given depending on the company that runs/owns the Jira instance.
- deleted 13y ago[deleted]
- alttab 13y agoThis. I also would rather just grab it in the browser instead of having to run a server or something else.
- shaneofalltrad 13y agoGreat idea on the bookmarklet. I could see a tool for building custom readers with clippings from various sites. Say I want to organize JavaScript array patterns and ideas. Throw in a way to clip parts of my PDF books into this "reader" and you have an amazing product worth millions.
- notastartup 13y agoCan you explain this more, how do you see this being operated? See a pdf, clip it, create your own reader with your own clips?
- notastartup 13y agohow would a bookmarklet be able to crawl & scrape a website?
- umurkontaci 13y agoYou can have javascript code as a bookmarklet
- notastartup 13y agoyes I know that but how would you make it crawl links in your browser?