3 ms·
For data frame implementations, you can also look at Spark's Dataset/DataFrame and Graphlab Create's SFrame. The company/team behind Graphlab Create was bought
by Notre1 9y ago
For data frame implementations, you can also look at Spark's Dataset/DataFrame and Graphlab Create's SFrame.
The company/team behind Graphlab Create was bought by Apple and the open sourced components haven't been updated since then. Because of that, I wouldn't use it in production, but if you are just looking for functioning implementations to compare, that gives you one more.
- chubot 9y agoThanks, I never heard of Graphlab Create. It is a substantial piece of code! It says it's "out of core", which means it's probably more similar to Parquet/ORC than Arrow. But still interesting. https://github.com/turi-code/SFrame/tree/master/oss_src/sframe https://github.com/turi-code/SFrame/tree/master/oss_src/sfra... For comparison, dplyr and arrow: https://github.com/tidyverse/dplyr/tree/master/src https://github.com/tidyverse/dplyr/tree/master/src https://github.com/apache/arrow/tree/master/cpp/src/arrow https://github.com/apache/arrow/tree/master/cpp/src/arrow C++ does seem to be useful for stuff like this.
- suresk 9y agoI thought GraphLab Create had some nice functionality, it is too bad that the Apple acquisition appears to have effectively killed the publicly available product. It doesn't look like you can even pay for the commercial part anymore.