6 ms·
A native Python IDE built for data science
- mrlinx 11y agoFinally, something very useful for anyone into python+data that doesn't like working inside a browser.
- ced 11y agoIn the last year, my workflow for data science/AI has completely shifted to Jupyter notebooks. Is there any IDE that offers a similar experience?
- plusepsilon 11y agoThere is Beaker notebooks which is similar to Jupyter. Haven't tried it but you can integrate multiple languages in one notebook. http://beakernotebook.com/ http://beakernotebook.com/
- chillacy 11y agoYou can do the same in ipython notebook (I'd presume jupyter as well) using magic commands: http://rpy.sourceforge.net/rpy2/doc-2.4/html/interactive.html#rmagic http://rpy.sourceforge.net/rpy2/doc-2.4/html/interactive.htm... It's kind of weird to use but it works for the most part. You can clean up some data in python, then push the data over to a cell written in R to do some other evaluation, then push the results back over to python.
- jupiter90000 11y agoI really like the idea behind beaker, but last time I played with it, the main issue/concern occurs for me when using a somewhat large (uses most of machine RAM) dataset, since using it in another language creates an additional copy of the data in memory for the other language to use. This multiplies the memory used by the number of languages that need an instance of the dataset. If there could be shared memory for datasets somehow, it would be much more useful (if they've figured that out since I last used it, please tell me).
- skierscott 11y agoYup, same experience (also for data science). The biggest helper I've had so far is jupyter-vim-bindings[1] [1]:https://github.com/lambdalisue/jupyter-vim-binding https://github.com/lambdalisue/jupyter-vim-binding
- jasongrout 11y agoJupyter dev here. FYI, we're currently working on building a new Jupyter web interface that resembles a more classic IDE experience, which we are calling JupyterLab. A first version is progressively coming together, and is planned to have code editor and terminal components. We also plan to have a notebook component, like the current notebook, in a later version. Our in-progress work is spread across many repos currently (see the various jupyter/jupyter-js-* repos on github).
- ced 11y agoSounds promising, thank you for working on this!
- ihaveajob 11y agoNeat tool, but watching the video, the grammar nazi in me couldn't stop looking at that "palendrome".
- theelfismike 11y agoSee also: Pycharm https://www.jetbrains.com/pycharm/ https://www.jetbrains.com/pycharm/
- TheLogothete 11y agoAnd also Pythons Tools for Visual Studio.
- tcfunk 11y agoOff-topic, but when did Jetbrains switch to the subscription model?
- j_s 11y agoThere was a big brouhaha about 4 months ago. https://news.ycombinator.com/item?id=10278285 https://news.ycombinator.com/item?id=10278285
- minimaxir 11y agoThe UI is obviously inspired by Rstudio for R. And I have zero objections to that; this is something that I've wanted for awhile, after having difficulty with PyCharm for my Python-related data projects. I'll play around with it a bit. As a heads up, the setup workflow assumes you are on OS X, which may be a problem if it asks you to open a Terminal on Windows: http://i.imgur.com/nya50e4.png http://i.imgur.com/nya50e4.png
- glamp 11y agohey minimaxir, the commands should still work if you have python and/or conda installed. if you have any issues you can post here: https://github.com/yhat/rodeo/issues https://github.com/yhat/rodeo/issues. thanks for trying it out!
- minimaxir 11y agoThat works for the pip command. Since people who analyze data may not necessarily be experts at the command line, I recommend relooking at this workflow. matplotlib, however, fails to install completely with this method on Windows for subtle reasons. Filed: https://github.com/yhat/rodeo/issues/204 https://github.com/yhat/rodeo/issues/204 The documentation just points to a blog article on how to install matplotlib on Windows.
- ekianjo 11y agoI realized the download on Linux is massive, though (600+ Mb) - why is that? R and RStudio combined weigh way less than that. Plus, for distributing binaries in Linux, instead of a zip file (tar.gz would be more common, too) it's better to support the main distros with a repository (PPA for Ubuntu, pacman for Arch, etc...) since it's way more user friendly every single time you want them to stay up to date.
- IndianAstronaut 11y agoFunny enough, I traded in Rstudio for Jupyter notebooks for R, especially for demos to other people since it is much easier to see tables, graphs and such.
- michaelperalta 11y agoI'm curious what advantages are there with this or (PyCharm) over something like Spyder?
- vittore 11y agoyeah, wonder what features are not covered by free version of PyCharm ( except of UI obviously copied from R)
- snydly 11y agoI'd like to know this too... Comparison between PyCharm, Canopy, Spyder, Yhat, etc. After using it for 10 minutes, it feels identical to RStudio. That's a good thing.
- plusepsilon 11y agoPyCharm is unparalleled in its understanding of code and it's great for building codebases. It is a programmer's tool first and foremost. I find PyCharm's interactive features clunky and have to do extra work to see the data. RStudio / Rodeo provides an interactive data analysis environment where multiple "views" are presented right in front of the user. A view could be a plot, a data frame or interactions between the code editor and the terminal. As a data analysis person it really helps to put the mental strain of code far away as possible and just explore the data. Jupyter Notebook are nice but it can get overwhelming (too much scrolling) when things get complicated. Great teaching tool, however. I think each of these tools have different use cases and it's great that Python is getting more user-friendly with the data science workflow.
- drvortex 11y agoIt doesn't seem to be able to work Python 3.5. It doesn't find the path and now the interface is stuck.
- balls187 11y agoWhat makes this specific for Data Scientists? Also curious about the performance of data-frame viewer for large data sets.
- ilyaeck 11y agoA pros/cons comparison to Jupyter would be helpful.
- yeukhon 11y agoJupyter or formerly known as IPython Notebook has a huge UX problem for me. The UI is made to be like notebook (no duh), but for larger codebase you want to have an editor-like UI. Jupyter maybe okay for demo.
- SwellJoe 11y agoI find the dramatic rise of Python (and open source tools in general) for scientific work interesting and cool. When I first started using Python many years ago, I was doing contract work for the SciPy/NumPy folks (Enthought), and Python was still a blip in the scientific world...Java and Fortran and a bit of C++ ruled the commercial world, with Mathematica and MatLab handling the academic side of things (with some overlap and some outliers). It's really cool to see. I like seeing science democratized, and Python is definitely a democratizing influence, and the fact that so much of it is open source is really fantastic. I've also noticed that a lot more domain experts are becoming programmer+domain experts through this evolution. It used to be that there were teams with a scientist to design it and one or more programmers to implement it, and that's becoming less of a requirement, which can accelerate the science-ing to a notable degree.
- _RPM 11y agoJust curious, what qualifies it as Native?
- bthornbury 11y agoI am curious about this as well. Taking a look at the source (https://github.com/yhat/rodeo https://github.com/yhat/rodeo) it appears to be in all python. I was under the (perhaps mistaken) impression that native referred to code which compiled to assembly.
- hueving 11y agoWhen referring to tooling for a language, 'native' tends to mean it's written in that language.
- danieltillett 11y agoI always thought native meant native to the platform.
- deleted 11y ago[deleted]
- revelation 11y agoLet's see, we're running a browser, which runs a JavaScript VM, which runs the our node.js logic, which runs Python, which calls into native numpy. See, native! I have this visceral reaction when I can tell something is based on Electron or IWebBrowser, 2.0.
- shotwell 11y agoas in native desktop
- jgamman 11y agohonest question: what if your science isn't maths/physics/data? I'm a chemist and from what i can see there's @#$@# all out there in FOSS land.
- TheLogothete 11y agoUse R! https://cran.r-project.org/web/views/ChemPhys.html https://cran.r-project.org/web/views/ChemPhys.html https://cran.r-project.org/web/views/Pharmacokinetics.html https://cran.r-project.org/web/views/Pharmacokinetics.html
- jhbadger 11y agoI doubt anyone doing data analysis is unfamiliar with R, as it is the current standard. The push to use Python, or Julia, or a version of Lisp (hey, we had that in the 1990s -- us olds remember xlispstat) for data analysis is coming from the people who find R to be a rather unpleasant language. Which is a subjective opinion, obviously, but not an uncommon one.
- baldfat 11y agoLearning Functional Programming (I learned Racket) makes R great since it really is a functional language.
- deleted 11y ago[deleted]
- analog31 11y agoExcellent question. Here's my chemistry cred: I'm married to a chemist, related to a couple more, and have worked in an area related to analytical chemistry, though I got my degree in physics, 2+ decades ago. So here are some generalizations. While in school, I noticed that the physics students were far more interested than the chemistry students, in math and computer stuff. Maybe we were computer science wannabees, or maybe we guessed (correctly in my case) that proficiency with computers would make us more employable. This was true in both undergrad and grad school. And there's a long tradition of physicists stealing ideas from math and computation for solving physics problems. When I was in school, computation was considered to be a specialized branch of chemistry, but was at the forefront of physics. Another difference is that the physics students were generally more interested in making our own tools. The current "maker" and "hacker" trends are old hat for small-lab experimental physicists. Chemistry has always been a bigger field than physics, which I suspect has attracted more interest in making commercial equipment and software. I've noticed in an industrial setting, that managers are often looking for closed solutions that can't be modified by the user, either for regulatory reasons or adversarial labor-management attitudes. The industry wants your boss to think that letting you make your own tools is either dangerous, or a waste of your time. In contrast, even in industry, physicists still have to make our own tools. And management already knows that we're freaks. ;-) So the absence of FOSS tools for chemistry doesn't shock me.
- simoneau 11y agoBy "native" they mean Electron-based deployment of HTML/JavaScript. More info: http://blog.yhathq.com/posts/how-rodeo-works.html http://blog.yhathq.com/posts/how-rodeo-works.html
- cgm616 11y agoI am desperately trying to get this to work with my pyenv-virtualenv anaconda installation, but I can't get it to work out. I also tried setting the path the ~/.pyenv/shims/python, but that didn't work out either.
- joelschw 11y agoWhy should I use this over Spyder?