4 ms·
Yes. Ish. Obviously text-oriented grep doesn't work. But table oriented duckdb can work very well indeed (and it basically combines a lot of awk and grep toget
by ted_dunning 4y ago
Yes. Ish.
Obviously text-oriented grep doesn't work. But table oriented duckdb can work very well indeed (and it basically combines a lot of awk and grep together)
$ duckdb <<EOQ
select count(\*) from 'archive.parquet' where sensor = 'wifi'
EOQ
┌──────────────┐
│ count_star() │
│ int64 │
├──────────────┤
│ 4719996 │
└──────────────┘
$
You can change a lot of aspects around such as the output format, but the point remains that you can do grepy things with Parquet files quite easily.