I haven't used ray, but I've read a bit of documentation on it and from what I gather, you install a daemon on the box (ray core) and can send it commands that

I haven't used ray, but I've read a bit of documentation on it and from what I gather, you install a daemon on the box (ray core) and can send it commands that it executes. Along the way, you can keep state, store data and schedule things. https://docs.ray.io/en/latest/ray-core/key-concepts.html#tasks https://docs.ray.io/en/latest/ray-core/key-concepts.html#tas... https://docs.ray.io/en/latest/ray-core/examples/gentle_walkthrough.html https://docs.ray.io/en/latest/ray-core/examples/gentle_walkt... That's what I would want something to do if I was building tooling like this myself. Although, I'd do it in golang instead of python so that the dependency chain was simpler. A single small binary is nicer imho.