3 ms·
Can you run software containers as steps ?
by speedgoose 5y ago
Can you run software containers as steps ?
- tchiotludo 5y agoYes, of course! You have 3 solutions for that: - you can use this task using runner:DOCKER property and choose the image: https://kestra.io/plugins/core/tasks/scripts/io.kestra.core.tasks.scripts.Bash.html https://kestra.io/plugins/core/tasks/scripts/io.kestra.core.... - you can also use PodCreate to launch a pod on a kubernetes cluster: https://kestra.io/plugins/plugin-kubernetes/tasks/io.kestra.plugin.kubernetes.PodCreate.html https://kestra.io/plugins/plugin-kubernetes/tasks/io.kestra.... - you have also CustomJob from VertexAI on GCP to be able to launch a container a ephemeral cluster (with any CPU / GPU): https://kestra.io/plugins/plugin-gcp/tasks/vertexai/io.kestra.plugin.gcp.vertexai.CustomJob.html https://kestra.io/plugins/plugin-gcp/tasks/vertexai/io.kestr...
- speedgoose 5y agoGreat! That makes Kestra more useful than Dagster for me.