4 ms·
Nice one! I like the SQL extension to denote the output format ("TO json"), great idea! It's also interesting that you allow calling python methods on values, r
by cube2222 5y ago
Nice one! I like the SQL extension to denote the output format ("TO json"), great idea! It's also interesting that you allow calling python methods on values, really neat!
If you're interested in tools like this, also make sure to check out OctoSQL[0], which has an extensible plugin architecture and lets you work with both files (JSON, CSV, ...) and databases (PostgreSQL, MySQL, ...) - even use all of them in a single query.
It also supports working with streaming data sources, with Kafka available soon.
Other than that, check out all the other notable tools in this area: datafusion, datasette, dsq, q, textql.
Disclaimer: I'm the author of OctoSQL.
- cube2222 5y ago[0]:https://github.com/cube2222/octosql https://github.com/cube2222/octosql
- dmoura 5y agoI know OctoSQL, I found the project super interesting, especially as you can merge different data sources. SPyQL is very single-stream oriented, much in line with command line tools (e.g. awk, grep, sed). I should be implementing soon a left join use case based on dictionary lookups, but I am not planning to implement more complicated joins in the near term, you have OctoSQL for that :-)