3 ms·
> You have been able to use dplyr on spark dataframes for a while now (at least a year) How? I didn't get it to work till sparklyr???? https://blog.rstudio.or
by baldfat 10y ago
> You have been able to use dplyr on spark dataframes for a while now (at least a year)
How? I didn't get it to work till sparklyr????
https://blog.rstudio.org/2016/09/27/sparklyr-r-interface-for-apache-spark/ https://blog.rstudio.org/2016/09/27/sparklyr-r-interface-for...
- blahi 10y agohttps://github.com/RevolutionAnalytics/dplyr-spark https://github.com/RevolutionAnalytics/dplyr-spark
- baldfat 10y ago> not yet endowed with a through test suite. Nonetheless we expect it to inherit much of its correctness, scalability and robustness from its main dependencies, dplyr and spark. > we don't recommend production use yet I was a bit disappointed by that package, though it is great to see it in the ecco-system of R. The RStudio sparklyr is 100% native and Production ready. You should check it out I was happily surprised.