4 ms·

The datasette tools are really great. I use them for pulling GitHub statistics, such as the distribution of GitHub followers, from their REST API into an SQLite

The datasette tools are really great. I use them for pulling GitHub statistics, such as the distribution of GitHub followers, from their REST API into an SQLite database with sqlite-utils(1).[1] Simon is in the 99th percentile (PR=0.998, n>25,000+) of GitHub users by followers. Thanks for such great tools, Simon! [1]: https://github.com/andrewmcwattersandco/github-statistics https://github.com/andrewmcwattersandco/github-statistics

simonw 5y ago
Wow, I didn't know SQLite databases could compress that well: github-users.tzst - 96MB Uncompressed: github-users.db - 992MB
- robbintt 5y ago
  It seems like either sqlite file format is already optimized for read or write at the cost of size, or there is an opportunity there.