2 ms·
I want the opposite. To have different processes for each step. Potentially the different steps being in different languages. Or at least semantics of that. Th
by jampekka 3y ago
I want the opposite. To have different processes for each step. Potentially the different steps being in different languages.
Or at least semantics of that. The steps should be independently callable and each call should result in the same output with same parameters, i.e. the state would reset for each run. I don't care so much how this is exactly implemented as long as it fullfills these.
The data doesn't need to stay in the process memory. It's can be e.g. mmapped and is cached by the OS anyway. And deserializing tens or even hundreds of megabytes takes usually less time than Julia takes to import Plots.
This is the thing that isn't feasible with Julia due to the TTFP (each step incurs the startup latency).