5 ms·
I don't think anyone who writes production code is using Jupyter as a development env. It's more like a self-documenting, persistent repl, or perhaps an interac
by ajford 6y ago
I don't think anyone who writes production code is using Jupyter as a development env. It's more like a self-documenting, persistent repl, or perhaps an interactive doc.
I've used it as a way to document data exploration for later use and as an interactive teaching tool. For that, being able to plot inline and embed interactive widgets is great. Also, mixing in rendered markdown content.
If you're using Jupyter to write python software and the software is the end result and not the data analysis/process, I think you might be doing it wrong.
Not that I'm discounting data scientists (or the like) who use it as their primary environment. Their end result is not a packaged/deployed software and the code itself is just ancillary. For those users, the code and environment is a tool, and the extra weight of what a full IDE (like VSCode or PyCharm) and the features they bring to the table are unnecessary and likely counter-productive.
- teruakohatu 6y ago> Not that I'm discounting data scientists (or the like) who use it as their primary environment. Unfortunately it often ends up needing to be executed as a batch job or integrated into a pipeline, which then starts the fun job of extracting the code from the notebook piece by piece. Jupyter having a plain text file format instead of json would make life so much easier, and vastly improve version control.
- boublepop 6y agoFor batch jobs you have papermill, for plaintext format you have the jupytext extension that pairs the Jain notebook with a script with notebook markup in comments. I honestly wish that they had used that format as just being the notebook format, but it’s a nice enough and easy fix.
- nojito 6y agoNetflix does and it’s absolutely horrifying. https://netflixtechblog.com/notebook-innovation-591ee3221233 https://netflixtechblog.com/notebook-innovation-591ee3221233 https://netflixtechblog.com/scheduling-notebooks-348e6c14cfd6 https://netflixtechblog.com/scheduling-notebooks-348e6c14cfd...
- Jugurtha 6y agoNot Netflix, but we do use notebooks on our internal platform. Long-running notebooks for model training, but you can view their state as they run even after you close the tab or get disconnected from the internet. We also publish AppBooks, which are automatically parametrized notebooks. However, we automatically detect and track experiments, and then we deploy models in the form of an endpoint to be invoked by consumers, with a convenience page for humans to invoke the code by sending JSON data, or uploading a CSV file. - https://iko.ai/docs/notebook/ https://iko.ai/docs/notebook/ - https://iko.ai/docs/appbook/ https://iko.ai/docs/appbook/