3 ms·
Prefect might work for your use-case: https://docs.prefect.io/ https://docs.prefect.io/
by brylie 4y ago
Prefect might work for your use-case:
https://docs.prefect.io/ https://docs.prefect.io/
- FridgeSeal 4y agoIMO the issue with things like Prefect (and the sinking comment suggestion of Toil) is the inextricable coupling with Python. We use Argo at my work, because we made the “unit of work” just a container that’s run by K8s. There isn’t a Python runtime around to run this stuff, and that’s a good thing. Same as with Pulumi, I’ve seen what devs do when you let them write arbitrary code anywhere-you end up with code that lives everywhere, confusingly cuts across different infrastructural layers with wild-abandon. It becomes difficult to on-board, difficult to maintain, the blast radius becomes unknown, and just because it’s Python, it will randomly break in 6 months because nobody pinned a transient dependency. YAML is awful. Argo could do with some trimming in its configs, but I’ll take it, and other “constrained” alternatives over arbitrary-code-in-Python-that-controls-resources-that-run-more-arbitrary code.
- atombender 4y agoI don't see the attraction of a language-specific framework. I don't use Python, and adding yet another language into the mix would just add complexity.