4 ms·
Yes, of course! You have 3 solutions for that: - you can use this task using runner:DOCKER property and choose the image: https://kestra.io/plugins/core/tasks
by tchiotludo 5y ago
Yes, of course!
You have 3 solutions for that:
- you can use this task using runner:DOCKER property and choose the image: https://kestra.io/plugins/core/tasks/scripts/io.kestra.core.tasks.scripts.Bash.html https://kestra.io/plugins/core/tasks/scripts/io.kestra.core....
- you can also use PodCreate to launch a pod on a kubernetes cluster: https://kestra.io/plugins/plugin-kubernetes/tasks/io.kestra.plugin.kubernetes.PodCreate.html https://kestra.io/plugins/plugin-kubernetes/tasks/io.kestra....
- you have also CustomJob from VertexAI on GCP to be able to launch a container a ephemeral cluster (with any CPU / GPU): https://kestra.io/plugins/plugin-gcp/tasks/vertexai/io.kestra.plugin.gcp.vertexai.CustomJob.html https://kestra.io/plugins/plugin-gcp/tasks/vertexai/io.kestr...
- speedgoose 5y agoGreat! That makes Kestra more useful than Dagster for me.