5 ms·
I've been working on a project along these lines recently. I've called it Dogsheep - the basic idea is to have scripts that export all manner of my personal dat
by simonw 7y ago
I've been working on a project along these lines recently. I've called it Dogsheep - the basic idea is to have scripts that export all manner of my personal data (from Google, Apple HealthKit, Twitter, LinkedIn etc) into SQLite database files, then use my Datasette web app to browse them and run interesting queries.
More about that here: https://dogsheep.github.io/ https://dogsheep.github.io/
The tools I've built so far are under https://github.com/dogsheep https://github.com/dogsheep
- jakeywankenobi 7y agoNice. Any interesting use cases for the genome one?
- karlicoss 7y agoLooks cool, I'll check it out! Might be good to join forces on scripts for data retrieval/parsing.
- austil 7y agoHey, I'm on this journey too ! https://github.com/austil/datapuller https://github.com/austil/datapuller
- ocdtrekkie 7y agoWhoa, this is super exciting to me. I've been looking for something that would get some of these types of data into a web-based interface that I could package for Sandstorm. This looks like it would potentially work for that fairly easily.
- deleted 7y ago[deleted]
- rasz 7y agoI went similar route after discovering Google Checkout refuses to return my YT comments. I wrote quick&dirty tempermonkey script logging submitted HTML forms (addEventListener "submit").
- TurkishPoptart 7y agoDid it work the way a scraper does? Curious to know how you did this.
- rasz 7y agoI was only interested in stuff I posted on the internet for indexing/easier search, https://developer.mozilla.org/en-US/docs/Web/API/HTMLFormElement/submit_event https://developer.mozilla.org/en-US/docs/Web/API/HTMLFormEle... and http://www.meekostuff.net/blog/Overriding-DOM-Methods/ http://www.meekostuff.net/blog/Overriding-DOM-Methods/ covered form submissions, result goes to tempermonkey localstorage (GM_setValue).
- gpchelkin 7y agoI think that Perkeep https://perkeep.org/ https://perkeep.org/ is also worth mentioning here. One of their latest tools is the one for exporting Google Photos: https://github.com/perkeep/gphotos-cdp https://github.com/perkeep/gphotos-cdp