5 ms·
I've uploaded the metadata to ClickHouse Playground for analysis. Example: https://play.clickhouse.com/play?user=play#U0VMRUNUIHByb2plY3RfbmFtZSwgc3VtKGxpbmVzK
by zX41ZdbW 3y ago
I've uploaded the metadata to ClickHouse Playground for analysis.
Example: https://play.clickhouse.com/play?user=play#U0VMRUNUIHByb2plY3RfbmFtZSwgc3VtKGxpbmVzKSwgc3VtKHNpemUpIEZST00gcHlwaSBXSEVSRSBza2lwX3JlYXNvbiA9ICcnIEFORCBwcm9qZWN0X25hbWUgSUxJS0UgJyVDbGlja0hvdXNlJScgR1JPVVAgQlkgcHJvamVjdF9uYW1lIE9SREVSIEJZIDIgREVTQw== https://play.clickhouse.com/play?user=play#U0VMRUNUIHByb2plY...
This is a nice dataset for exploration, although small (only one billion records). Going to upload all lines of code...
- zX41ZdbW 3y agoAlthough the same query can be run directly from Parquet files with clickhouse-local: clickhouse-local --query "SELECT project_name, sum(lines), sum(size) FROM '*.parquet' WHERE skip_reason = '' AND project_name ILIKE '%ClickHouse%' GROUP BY project_name ORDER BY 2 DESC" https://clickhouse.com/blog/extracting-converting-querying-local-files-with-sql-clickhouse-local https://clickhouse.com/blog/extracting-converting-querying-l...
- orf 3y agoThanks, that’s really neat. I’ll see if I can embed it somehow onto the site. I was looking into some browser duckdb WASM setup that reads the parquet files via http but I ran out of steam.
- orf 3y agoI’ve embedded it on this page here: https://py-code.org/datasets https://py-code.org/datasets Thanks so much for that!