3 ms·
>How is it better that SQL for these tasks on tabular data? It has far better handling of a CSV/TSV file on the command line directly and is compasable in shel
by coldtea 4y ago
>How is it better that SQL for these tasks on tabular data?
It has far better handling of a CSV/TSV file on the command line directly and is compasable in shell pipelines.
>My point, if one wants cat, sort, sed, join on tabular data, SOL is exactly that.
SQL is a language for data in the form of tables in relational databases.
While it can do sorting or joining or some changes, it is meant for a different domain than these tools, which other constraints, other concerns, and other patterns of use...
You don't need to load anything to a db, for starters.
You also normally don't care for involving a DB in order to use in a shell script, or for quick shell exploration.
You also can't mix SQL and regular unix userland in a pipeline (well, with enough effort you can, but it's not something people do or need to do).
- holy_diver 4y agoDuckDB is actually pretty good at this kind of thing. Doesn't need to load anything to DB Can be used in shell Can read from stdin and write to stdout
- avodonosov 4y agocsvsql is the first google result for "sql in command line for csv" https://towardsdatascience.com/analyze-csvs-with-sql-in-command-line-233202dc1241 https://towardsdatascience.com/analyze-csvs-with-sql-in-comm...
- coldtea 4y agoYes, I know. It's not that there isn't several ways to do it, it's that it's not really a good fit for the command line, except in the "I want to reuse SQL that I already know". The problem isn't in having a way to use SQL to query the data from the command line, it's that SQL is long winded and with syntax not really fit in a traditional shell pipeline.
- avodonosov 4y agoI submitted a ticket: https://github.com/johnkerl/miller/issues/1235 https://github.com/johnkerl/miller/issues/1235