3 ms·
If you want to see an incredibly successful data manipulation system that works exactly as you describe, you should check out R's dplyr package immediately. To
by civilized 5y ago
If you want to see an incredibly successful data manipulation system that works exactly as you describe, you should check out R's dplyr package immediately. To me it's the perfect composable SQL API, but hardly anyone knows about it outside of R/RStudio/tidyverse aficionados!
It also cross-compiles to SQL and can thus be used to build queries, although the result is not necessarily the most efficient. Someday I hope someone with expertise in compilation and query optimization will take a look at dplyr and figure out how to get it to generate optimally efficient SQL.
If we did that, and also ported dplyr to some other languages, programmers might never have to hand-write SQL again. (LINQ might be a good way too, but I know much less about it)
- BoiledCabbage 5y agoIf you like dplyr in R, you really should check out Linq. Dplyr as nice as it is doesn't remotely compare to how sensible and ergonomic Linq is.
- civilized 5y agoI've heard! I don't have much occasion to use Linq as a data scientist, but will definitely keep an eye out if I ever write C#, etc.
- flakiness 5y agoKind of sad Hadley Wickham isn't as prolific as a paper writer anymore. These papers [1] were, as its nature, very consumable even for someone outside R community. I liked them a lot. [1] https://scholar.google.com/citations?user=YA43PbsAAAAJ&hl=en&oi=ao https://scholar.google.com/citations?user=YA43PbsAAAAJ&hl=en...
- civilized 5y agoTotally agree... but if I have to choose between him writing papers and spending more time perfecting APIs, there's no question. The man is one of the most brilliant interface designers ever to live. Dplyr was already great in its first version, but Hadley and company have worked incredibly hard to make it much, much better. It's hard to think of another system that has improved so much from such an already high starting point.
- flakiness 5y agoThat's fair point. I'm mostly on Python so I cannot complain.