5 ms·

I have never deployed or built a K8s cluster, but recently I moved about a dozen AWS ECS Fargate workloads into a K8s cluster that a colleague of mine has setup

by _wldu 5y ago

I have never deployed or built a K8s cluster, but recently I moved about a dozen AWS ECS Fargate workloads into a K8s cluster that a colleague of mine has setup. I was surprised. I really like it (from the perspective of a user/developer). I deploy my apps by updating a simple yaml file in a git repo. All my other practices (vim, go code with standard Makefiles, docker container image registry) are unchanged. I also think K8s is a reasonable cloud independent abstraction when you need to move your workloads to another provider. It prevents cloud lock-in. And I suppose Nomad would do that too. So far my K8s experience has been very good. However, if I ever have to do more with it (on the administrative side) I may have a less positive experience. Not sure.

tekkk 5y ago
What was wrong with ECS Fargate if you don't mind me asking? Too expensive? Too vendor locked-in?
- _wldu 5y ago
  We want to apply consistent policies and technical controls across multiple dev groups that have multiple AWS accounts. K8s seems to be a good solution for that.
  - throwaway923840 5y ago
    Was it not possible in ECS? Or did your teams just want to use K8s, and decided they would use the opportunity of wanting to organize things better as a reason to switch? It seems to me that with SSO and IAM you could create virtually any kind of access controls around ECS. K8s doesn't solve the multi-account problem, and federation in K8s can be quite difficult.
  - tekkk 5y ago
    All right, thanks! Just wondered as I have a ECS setup and I really prefer not having to switch unless I have to.
  - still_grokking 5y ago
    I'm not a fan of AWS but to be fair it has all those features OOTB. You can have AWS "organizations" managing multiple accounts. IAM will allow to set up any policies you want in your organization. On the other hands side now you have a multitude of complexity added to your setup… If I would be snarky I would see a case of "resume driven development". But let's just assume it was lack of time to find the simplest solution and it's than often preferred to just go with the flock as so many others can't be possibly wrong.
- roland35 5y ago
  Not op, but I can't imagine ecs being cheaper than eks since ecs itself is free (you pay for fargate either way) Ecs is pretty simple but does not have the large mindshare that kubernetes or nomad have.
capableweb 5y ago
While interesting in itself, I'm not sure how this is relevant to this Nomad blogpost, unless you tried Nomad before starting to use Kubernetes and went with Kubernetes anyways.

by _wldu 5y ago

tekkk 5y ago

What was wrong with ECS Fargate if you don't mind me asking? Too expensive? Too vendor locked-in?

_wldu 5y ago
We want to apply consistent policies and technical controls across multiple dev groups that have multiple AWS accounts. K8s seems to be a good solution for that.
- throwaway923840 5y ago
  Was it not possible in ECS? Or did your teams just want to use K8s, and decided they would use the opportunity of wanting to organize things better as a reason to switch? It seems to me that with SSO and IAM you could create virtually any kind of access controls around ECS. K8s doesn't solve the multi-account problem, and federation in K8s can be quite difficult.
- tekkk 5y ago
  All right, thanks! Just wondered as I have a ECS setup and I really prefer not having to switch unless I have to.
- still_grokking 5y ago
  I'm not a fan of AWS but to be fair it has all those features OOTB. You can have AWS "organizations" managing multiple accounts. IAM will allow to set up any policies you want in your organization. On the other hands side now you have a multitude of complexity added to your setup… If I would be snarky I would see a case of "resume driven development". But let's just assume it was lack of time to find the simplest solution and it's than often preferred to just go with the flock as so many others can't be possibly wrong.
roland35 5y ago
Not op, but I can't imagine ecs being cheaper than eks since ecs itself is free (you pay for fargate either way) Ecs is pretty simple but does not have the large mindshare that kubernetes or nomad have.

capableweb 5y ago

While interesting in itself, I'm not sure how this is relevant to this Nomad blogpost, unless you tried Nomad before starting to use Kubernetes and went with Kubernetes anyways.