3 ms·

This was a super information-rich video and I’ll definitely have to check out the Datasette library. But when I think of a “personal data warehouse”, I see a lo

This was a super information-rich video and I’ll definitely have to check out the Datasette library. But when I think of a “personal data warehouse”, I see a lot more utility in centralizing financial data (cash, assets, debts, receipts), health records, government documents, and other more... non-trivial information. The examples of “plot your dogs weight over time by filtering tweets” and “rank pictures you’ve taken of Pelicans by ML-graded aesthetic quality” are delightful but absurdly frivolous (and I honestly can’t tell whether they were meant as serious examples or not..). What I want this to be is a kind of mint.com, but with the ability to ingest from a wider swath of sources, and without having to grant a third party app access to my bank account. I’m sure many companies have tried to make all-encompassing life-tracker tools that I’m not aware of, but I’m equally certain that they have serious security and privacy problems. And it’s entirely possible that this is all just wishful thinking... that centralizing sensitive data in this way will always create a single point of failure that is inherently risky.

simonw 6y ago
The examples I use are meant to be frivolous and amusing, but more importantly they're examples that it's safe to share in a demo. I've done some work on importing financial details into SQLite and Datasette (so far just using CSV exports from online banking) but they're not something I'm comfortable sharing in a video! I should probably add a note about those to my presentations - explicitly call out that you can absolutely import financially sensitive data into a personal data warehouse like this, but it won't be something you'll want to show other people.
- plaidfuji 6y ago
  First of all, I appreciate the response! The examples were good - they demonstrated the flexibility and depth of the tool. I suppose I’m just lamenting the fact that I’d like to use this tool to create a data warehouse for sensitive financial info, but I don’t trust myself to ensure I wouldn’t be creating a massive risk of identity theft, given my level of security expertise.. again, loved the video.
brnt 6y ago
Its not exactly what you're thinking of, but have a look at Firefly-III.

simonw 6y ago

The examples I use are meant to be frivolous and amusing, but more importantly they're examples that it's safe to share in a demo. I've done some work on importing financial details into SQLite and Datasette (so far just using CSV exports from online banking) but they're not something I'm comfortable sharing in a video! I should probably add a note about those to my presentations - explicitly call out that you can absolutely import financially sensitive data into a personal data warehouse like this, but it won't be something you'll want to show other people.

plaidfuji 6y ago
First of all, I appreciate the response! The examples were good - they demonstrated the flexibility and depth of the tool. I suppose I’m just lamenting the fact that I’d like to use this tool to create a data warehouse for sensitive financial info, but I don’t trust myself to ensure I wouldn’t be creating a massive risk of identity theft, given my level of security expertise.. again, loved the video.

brnt 6y ago

Its not exactly what you're thinking of, but have a look at Firefly-III.