6 ms·

Tekton Pipelines – K8s-style resources for declaring CI pipelines

83 points by based2 7y ago

samtrack2019 7y ago
Interesting but is it another argocd?
- based2 7y ago
  https://argoproj.github.io/argo-cd/ https://argoproj.github.io/argo-cd/
  - thanatos_dem 7y ago
    Yeah, pretty similar overall. Tho Tekton is also the underlying technology for Jenkins X. With Jenkins being such a common system in the CI/CD space, I think we'll see Tekton preferred going forward. https://jenkins-x.io/ https://jenkins-x.io/
    - alexeldeib 7y ago
      That...is an interesting dependency direction? Isn't Tekton MUCH newer? Are they developed by similar people?
      - dlor 7y ago
        Different groups of people working on the two projects, though we communicate pretty frequently.
    - empath75 7y ago
      Even the Argo team isn’t investing much effort into Argo workflows and Argo ci.
      - saradhis 7y ago
        I'm not sure what gives that impression, but Argo Workflows is under heavy development and is used by several large organizations, including Intuit (Argo team is part of Intuit).
- dlor 7y ago
  A closer comparison would be to Argo Workflow. Tekton and Argo Workflow provide ways to declare workflow pipelines for execution on Kubernetes. Tekton focuses on source based workflows, while Argo is more general purpose. We've been working with the Argo team to make sure Argo CD works well with Tekton, and we now have a first-class integration in the tekton catalog, contributed by that team. Disclosure: one of the leads and founders of the Tekton project.
  - product1087 7y ago
    How much, if at all, has the investment from Google in open source projects like Tekton changed at all with the post-Diane Greene leadership?
    - dlor 7y ago
      I can't speak for projects in general, but I haven't noticed any changes on Tekton or the other things I work on.
  - dcosson 7y ago
    Would you normally recommend running tekton in its own k8s cluster, or within the same cluster that runs production workloads? (Particularly if running in something like gke or eks)
  - jessesuen 7y ago
    Lead and core contributor to Argoproj here. I agree that Tekton and Argo Workflows share a closer comparison than with Argo CD (despite the "CD" acronym appearing in the name Tekton CD). Workflows is aimed to be a more general purpose workflow engine. I like to explain workflows as a fancy Kubernetes Job object, which can be used as a building block to higher level applications. I believe the majority of workflow users are using workflows for ML, ETL, data processing pipelines. Its strength is being able to leverage your kubernetes cluster as an auto-scaling compute grid, with highly advanced scheduling capabilities (i.e. scheduling based on node attributes, pod priorities, resource requirements, etc...). That said, a fair share of users are using workflows as a lightweight CI solution, though it requires work to glue in other components to provide the complete solution (e.g. Argo Events to handle git webhooks)
- empath75 7y ago
  This handles the ci part. Argo handles the cd. I use them both together now.
  - dlor 7y ago
    I'd love to hear more about how you're using them if you don't mind sharing. I work on Tekton at Google.
    - empath75 7y ago
      Essentially just replacing kubectl apply in a normal Tekton pipeline with a git push and telling Argo to sync.
RickJWagner 7y ago
Looks like a pretty strong string of commits. This one has some mojo.
je42 7y ago
is there a good resource to read up how does this differs from the normal K8S tasks ?
war1025 7y ago
I literally just today bought a Tekton [1] torque wrench and was wondering what business they had that required CI pipelines. Different company. [1] https://www.tekton.com/ https://www.tekton.com/
powerball 7y ago
The focus on source based flows is the right product decision here --- wonder if it unnaturally constrains the market and effectively cede ubiquity to a more generic tool What is the plan here?
- dlor 7y ago
  I think most things in software trade-off between general purpose and specialized. My 2c is that we'll see more and more things become source-based over time. We're already seeing it with infra as code, gitops, git-ml, etc. If the scope of Tekton expands, it will be because more things become source-based. And that would be great for everyone. Disclosure: one of the leads and founders of Tekton, at Google.

83 points by based2 7y ago

samtrack2019 7y ago

Interesting but is it another argocd?

based2 7y ago
https://argoproj.github.io/argo-cd/ https://argoproj.github.io/argo-cd/
- thanatos_dem 7y ago
  Yeah, pretty similar overall. Tho Tekton is also the underlying technology for Jenkins X. With Jenkins being such a common system in the CI/CD space, I think we'll see Tekton preferred going forward. https://jenkins-x.io/ https://jenkins-x.io/
  - alexeldeib 7y ago
    That...is an interesting dependency direction? Isn't Tekton MUCH newer? Are they developed by similar people?
    - dlor 7y ago
      Different groups of people working on the two projects, though we communicate pretty frequently.
  - empath75 7y ago
    Even the Argo team isn’t investing much effort into Argo workflows and Argo ci.
    - saradhis 7y ago
      I'm not sure what gives that impression, but Argo Workflows is under heavy development and is used by several large organizations, including Intuit (Argo team is part of Intuit).
dlor 7y ago
A closer comparison would be to Argo Workflow. Tekton and Argo Workflow provide ways to declare workflow pipelines for execution on Kubernetes. Tekton focuses on source based workflows, while Argo is more general purpose. We've been working with the Argo team to make sure Argo CD works well with Tekton, and we now have a first-class integration in the tekton catalog, contributed by that team. Disclosure: one of the leads and founders of the Tekton project.
- product1087 7y ago
  How much, if at all, has the investment from Google in open source projects like Tekton changed at all with the post-Diane Greene leadership?
  - dlor 7y ago
    I can't speak for projects in general, but I haven't noticed any changes on Tekton or the other things I work on.
- dcosson 7y ago
  Would you normally recommend running tekton in its own k8s cluster, or within the same cluster that runs production workloads? (Particularly if running in something like gke or eks)
- jessesuen 7y ago
  Lead and core contributor to Argoproj here. I agree that Tekton and Argo Workflows share a closer comparison than with Argo CD (despite the "CD" acronym appearing in the name Tekton CD). Workflows is aimed to be a more general purpose workflow engine. I like to explain workflows as a fancy Kubernetes Job object, which can be used as a building block to higher level applications. I believe the majority of workflow users are using workflows for ML, ETL, data processing pipelines. Its strength is being able to leverage your kubernetes cluster as an auto-scaling compute grid, with highly advanced scheduling capabilities (i.e. scheduling based on node attributes, pod priorities, resource requirements, etc...). That said, a fair share of users are using workflows as a lightweight CI solution, though it requires work to glue in other components to provide the complete solution (e.g. Argo Events to handle git webhooks)
empath75 7y ago
This handles the ci part. Argo handles the cd. I use them both together now.
- dlor 7y ago
  I'd love to hear more about how you're using them if you don't mind sharing. I work on Tekton at Google.
  - empath75 7y ago
    Essentially just replacing kubectl apply in a normal Tekton pipeline with a git push and telling Argo to sync.

RickJWagner 7y ago

Looks like a pretty strong string of commits. This one has some mojo.

je42 7y ago

is there a good resource to read up how does this differs from the normal K8S tasks ?

war1025 7y ago

I literally just today bought a Tekton [1] torque wrench and was wondering what business they had that required CI pipelines. Different company. [1] https://www.tekton.com/ https://www.tekton.com/

powerball 7y ago

The focus on source based flows is the right product decision here --- wonder if it unnaturally constrains the market and effectively cede ubiquity to a more generic tool What is the plan here?

dlor 7y ago
I think most things in software trade-off between general purpose and specialized. My 2c is that we'll see more and more things become source-based over time. We're already seeing it with infra as code, gitops, git-ml, etc. If the scope of Tekton expands, it will be because more things become source-based. And that would be great for everyone. Disclosure: one of the leads and founders of Tekton, at Google.