5 ms·
This causes issues when working with large data sets or running expensive operations, which is an advantage of modifying a single step independently from the re
by wting 8y ago
This causes issues when working with large data sets or running expensive operations, which is an advantage of modifying a single step independently from the rest.
- reilly3000 8y agoAs an example, loading up a dataset I was working with into RAM from my NVME drive took about 9 minutes each time. Rerunning that step on each script run is productivity-prohibitive as I am just trying to explore and clean the data.
- jules 8y agoCopy on write handles most cases fine. You can also still use such a system as a repl: just add more lines and don't modify previous lines. If you do that then nothing needs to be re-executed. Since most people work with small data sets or can use a subset of their dataset during development, I think this would be a better default for a notebook.
- phonon 8y agohttp://www.pgbovine.net/incpy.html http://www.pgbovine.net/incpy.html