4 ms·
If anyone is interested in working on this (or other exciting Spark related things) @ IBM please reach out to me ( my HN username with the letter k removed at u
by holdenk 11y ago
If anyone is interested in working on this (or other exciting Spark related things) @ IBM please reach out to me ( my HN username with the letter k removed at us.ibm.com )
- michaelsbradley 11y agoHas there been any work toward integration with IPython/Jupyter?
- nl 11y agoGetting IPython/Jupyter connected to Spark isn't hard. I did it following a combination of these two guide: http://ramhiser.com/2015/02/01/configuring-ipython-notebook-support-for-pyspark/ http://ramhiser.com/2015/02/01/configuring-ipython-notebook-... http://thepowerofdata.io/configuring-jupyteripython-notebook-to-work-with-pyspark-1-4-0/ http://thepowerofdata.io/configuring-jupyteripython-notebook... Edit, if this is interesting then... https://news.ycombinator.com/item?id=10496385 https://news.ycombinator.com/item?id=10496385
- acangiano 11y agoMy team at IBM is developing a tool that integrates several key data science open source technologies all in one. It's called the Data Scientist Workbench (http://datascientistworkbench.com http://datascientistworkbench.com). It doesn't currently support SystemML yet, but it already integrates iPython/R/Scala with Spark, for example. The idea is to have all the tools you'll need for data analysis and visualization, in the cloud, directly accessible anytime from your browser. We plan to include SystemML in the future.