4 ms·
Sort of off-topic, but for me Jupyter is 90% of the way there to dominating my data analysis / ML work-flow, but that last 10% kills it for me: - Weird behavio
by highd 9y ago
Sort of off-topic, but for me Jupyter is 90% of the way there to dominating my data analysis / ML work-flow, but that last 10% kills it for me:
- Weird behavior when disconnecting / reconnecting to sessions, especially from multiple computers.
- Tendency to flake out on long running jobs, i.e. 2 hours of the way through a 4 hour algorithm something dies and I have to restart or run from terminal.
Unfortunately this relegates it to exploratory viz for me, but maybe that's the intended use case anyway. But when I've wanted to build semi-persistent dashboards or check in on running jobs I've had better luck with ssh+screen and then dumping pdfs of results with matplotlib to files that I serve from a webserver with a little auto-refresh javascript wrapper.
- marmaduke 9y agoWhat versions are you running? Jupyter or at least its predecessor IPython notebook have always been rock solid for me, running for days and days. That said, I always made sure to save before disconnect and refresh on reconnect.
- nafizh 9y agoThis is so true. I love jupyter notebooks, but running a program that will run for 5 days is a nightmare, you don't know when the kernel will just crash. Also, if there are lots of constant output/logging, you have to make sure that it comes on the terminal, if it is in the notebook itself, it will just freeze.