3 ms·
I've been approaching this problem from a slightly different direction: I'm constructing a set of tools for converting different data formats into SQLite, becau
by simonw 7y ago
I've been approaching this problem from a slightly different direction: I'm constructing a set of tools for converting different data formats into SQLite, because once your data is in SQLite you can join it, filter it and do all kinds of other useful SQL things on top of it.
Tools I've written so far include:
https://github.com/simonw/csvs-to-sqlite https://github.com/simonw/csvs-to-sqlite - convert CSV files to a SQLite database
https://sqlite-utils.readthedocs.io/en/stable/cli.html https://sqlite-utils.readthedocs.io/en/stable/cli.html - convert JSON files
https://github.com/simonw/db-to-sqlite https://github.com/simonw/db-to-sqlite - export data from any SQL database supported by SQLAlchemy (e.g. MySQL and PostgreSQL) into a SQLite file
More tools here: https://datasette.readthedocs.io/en/stable/ecosystem.html#tools-for-creating-sqlite-databases https://datasette.readthedocs.io/en/stable/ecosystem.html#to...
The end goal is to have databases I can load up in my Datasette web application tool so I can run SQL and export the results as JSON/CSV: https://datasette.readthedocs.io/ https://datasette.readthedocs.io/
- cube2222 7y agoThis looks great! However, we're aiming for datasources which are either too big to download or change frequently, so also have very different goals really. (the same SQL for everything inspiration though!)