5 ms·
I can see that Wes is a reporter for Spark issue (https://issues.apache.org/jira/browse/SPARK-13534 https://issues.apache.org/jira/browse/SPARK-13534), what are
by mziel 11y ago
I can see that Wes is a reporter for Spark issue (https://issues.apache.org/jira/browse/SPARK-13534 https://issues.apache.org/jira/browse/SPARK-13534), what are the plans (if any) for tighter Spark/Python/R DataFrames integration?
- wesm 11y agoI'd like to see SPARK-13534 completed so that we can bring Spark to Python/R data access performance reach a level we can deem "acceptable". I dug into this issue a bit here: http://wesmckinney.com/blog/pandas-and-apache-arrow/ http://wesmckinney.com/blog/pandas-and-apache-arrow/