11 ms·
Amazon EKS – Highly available and scalable Kubernetes service
- zegl 9y agoIt's not surprising, but this is a very welcome announcement!
- mk89 9y agoFinally!!!
- chrisbolt 9y agoAnnouncement: https://aws.amazon.com/blogs/aws/amazon-elastic-container-service-for-kubernetes/ https://aws.amazon.com/blogs/aws/amazon-elastic-container-se...
- brango 9y agoThanks Amazon! Now I can finally drop GCP :-)
- einfach 9y agoI'm curious about your reasons for wanting to drop GCP. I am having a grass-is-greener-on-the-other-side moment right now being on AWS.
- brango 9y agoGoogle's approach to auth is cumbersome and leaves a lot to be desired. Also, there's nothing like cloudformation for configuring supporting services (their equivalent is a pathetic joke). The only thing I'd use GCP for today is bigquery. For everything else I'd rather use AWS.
- rifung 9y agoI work for Google.. Sorry to hear that your experience was poor but thanks for the candid feedback! Is the equivalent to CloudFormation on GCP supposed to be Deployment Manager? Would you mind elaborating what could have been done better? I work closely with them so I can at least relay the feedback. If it's easy enough maybe I'll even get to help since I am interested in working on that project =D
- brango 9y agoYes Deployment Manager. I can't remember now. I looked at it when I needed to automate something and found that I couldn't do it. IIRC it seemed too limited in its capabilities. The GKE auth thing is so bad to the point we had to roll back from using service accounts to using normal API keys because there was nowhere in stack driver to add a service account key file. So the choice was either lose all our endpoint monitoring or just switch to API keys. When I opened a support ticket about this the support guy seemed incompetent. He literally couldn't understand what I was saying despite repeating myself 3 times in a way I struggled to make any clearer. It wasn't worth the hassle. I'm running a gRPC/REST service on GKE with Endpoints and to add a new credential I needed to add the key to the service.yml file and update the endpoint. There's no way that scales. I can't wait to use AWS IAM for this instead. We had to backtrack and give out API keys instead of having anything better. Follow this tutorial for what I was trying to do before going back to just normal API keys: https://cloud.google.com/endpoints/docs/grpc/authenticating-users-grpc https://cloud.google.com/endpoints/docs/grpc/authenticating-... It's like GCP services weren't designed to work with each other. Just a hodgepodge of services that are fine if you can run CLI commands, but as soon as you want to get an ops team involved who want to do everything through a UI you're screwed. Oh, and I can't tell you how frustrating it is for the k8s alpha clusters to just vanish on you. I'm a big boy. Let me decide when I want to kill an alpha cluster because, you know, I might know better than whichever engineer put that 30 day limit in. Sorry for the rant, but as you can imagine I'm done with GCP and can't wait to head back to AWS land.
- rifung 9y ago> Sorry for the rant, but as you can imagine I'm done with GCP and can't wait to head back to AWS land. Nonsense, the feedback is much appreciated! Thanks for taking the time!
- azurezyq 9y agoIs the equivalent you mentioned Cloud Deployment Manager? Could you provide a bit more detail about what is missing there? I work on data processing & analytics at Google Cloud. Really glad to know you love BQ. :)
- oxplot 9y agoTerraform [1] should be preferred over both Google's and Amazon's as it supports cross cloud provisioning and provides features such as update plan which are crucial for making low risk changes to infra. [1]: https://www.terraform.io/ https://www.terraform.io/
- deleted 9y ago[deleted]
- manigandham 9y agoGCP has great primitives that you can use to build your architecture. Things are generally faster, cheaper (with far simpler billing), and scale without any tuning. However their biggest weakness is the overall alpha/beta stage of many APIs and the lack of managed services. AWS, especially with these recent announcements, has so many managed services that you can get started building your business product quicker than anywhere else, even if the offerings and billing are more complex. GCP does have some things like Spanner and BigQuery that are unmatched though.
- JulianRaphael 9y agoRegarding Spanner, AWS now provides Global Tables for Dynamo DB and a Multi-Master feature for Aurora. Very interesting move. https://venturebeat.com/2017/11/29/aws-cloud-databases-go-serverless-and-multi-master/ https://venturebeat.com/2017/11/29/aws-cloud-databases-go-se...
- dvlsg 9y agoAnd dynamodb style "serverless" functionality / billing for aurora, looks like. I would have loved that about a week ago.
- manigandham 9y agoRight, Azure has an interesting offering for a global database with CosmosDB but AWS is leaping ahead of the game with global tables and multi-master/region Aurora, which are far more usable and productive than the others.
- brown9-2 9y agothe lack of managed services What about GKE, if EKS makes you want to jump to AWS?
- manigandham 9y agoThat's a different user. We run on GCP/GKE and aren't moving, but by managed services I'm talking about the multitude of products that AWS offer in a managed version, everything from NFS to a graph database now. It makes building products very easy since you have an answer for any infrastructure need. Azure comes close but GCP is very far behind. What's there is nice and well designed, but leaves a lot of gaps to fill in.
- eknkc 9y agoWe ditched managed kubernetes on GCP and rolled our own using kops on AWS. Things are more stable. ELB works better than Google Cloud load balancer which had random issues and meltdowns when we were there. Also support is better. I’d not go back, your mileage may vary.
- maktouch 9y agoWow that's weird. We actually did the inverse, from AWS + Kops to GKE. In our case, the cluster just stopped working suddenly. Been using GKE for over a year now. No issues at all.
- eknkc 9y agoWeird indeed :) Did the entire cluster just stopped working or the kubernetes api server on master?
- koshak 9y agoWhat region were you living in?
- eknkc 9y agous-central1
- Rezo 9y agoI think almost everyone was expecting this, still, it's great to see it happen. Amazon truly listens to their customers and delivers what they want, even if they have their own competing in-house solution as well. I do think that for new projects, you'll see EKS being the more popular pick over ECS, which never reached quite the same mind-share as Kubernetes.
- mk89 9y agoECS will slowly be replaced, it doesn't make any sense anymore, and AWS was totally smart to "kill" their own product. Either you do like this, or you are out. Google and Azure provide K8 since months now... Companies want more and more solutions which allow them to "easily" migrate from one cloud to another - having everything based on a proprietary solution is no go...
- andrewstuart2 9y agoECS always felt rushed to me. The semantics of day-to-day operations always felt really awkward. Common things like rolling updates were a 3-step operation (or they were for us), and node replacement was a pain. It could be that we were using it wrong, but I never felt motivated to find out the right way. Kubernetes came along, I played with it briefly, and never wanted to go back. I think ECS will, and should, be retired. It was a lurch in the right general direction, but ultimately missed the mark.
- zenlikethat 9y agoIt WAS rushed. Amazon has customers banging on their door demanding container support in 2014 and they got ECS out the door, fast. Now it’s 2017 and Kubernetes seems to be the winner of the “orchestration wars” so they’re pivoting to that. Smart move of them to ship something and patch it up later if needed, they successfully defended against GKE’s assault and are vying to stay on top.
- toomuchtodo 9y ago> Smart move of them to ship something and patch it up later if needed, they successfully defended against GKE’s assault and are vying to stay on top. If you had to release a product to support the open source front runner, you did not successfully defend against it; you conceded after your tooling adoption failed. As long as Kubernetes leads the way, lock in at any cloud provider is prevented (can even move back on-prem when the winds shift again). Kudos to Google for enabling that, but they have their own motives (ie disrupting AWS uptake).
- s0l1dsnak3123 9y agoBrilliant, We're rolling out a k8s setup right now on AWS - having a managed k8s that we can upgrade nicely would be amazing.
- meddlepal 9y agoNot surprising ever since AWS joined the CNCF. Glad this is happening... not operating a Kubernetes cluster will be nice and integration with IAM is a nice value add! Most excellent :)
- kemitche 9y agoRBAC via IAM will be a huge selling point for this.
- nikon 9y agoHappy with Kops but this is awesome. Especially if the controller is not billed for (like Azure and now GCP).
- puzzle 9y agoHow does one set up the workers? None of the announcements, documentation or FAQs explain how that's supposed to happen. It's pretty clear that Amazon manages the masters (any of the latest three public versions), but it's not clear what you'd do next: bring your own instances with kubelet and do TLS bootstrapping or similar?
- moondev 9y agoI would guess AMI + userdata to point to the master(s)
- puzzle 9y agoSo you're going to have to use a subset of possible distros/images. Then you have to figure your node update strategy. These are the kind of details I hoped they would discuss.
- arungupta 9y agoWe'll provide AMIs with pre-configured images and Kubernetes resources. Customers have complete control over the worker nodes. With Fargate integration, node management will be painfree. We'll show how the images are built using Packer. You are welcome to bring your own images. Worker nodes upgrade will be the usual k8s way - drain, update, bring it back.
- mariojv 9y agoDoes anyone know what the implementation(s) are for the Ingress resource? Google uses their own custom implementation, I'm curious if Amazon's version will be more portable. [0] [0] https://cloud.google.com/kubernetes-engine/docs/tutorials/http-balancer#step_3_create_an_ingress_resource https://cloud.google.com/kubernetes-engine/docs/tutorials/ht...
- xur17 9y agoI'm assuming Amazon will also write their own custom implementation that controls elbs.
- SEJeff 9y agoOr something akin to this: https://github.com/coreos/alb-ingress-controller https://github.com/coreos/alb-ingress-controller And the blog post with a full writeup: https://aws.amazon.com/blogs/apn/coreos-and-ticketmaster-collaborate-to-bring-aws-application-load-balancer-support-to-kubernetes/ https://aws.amazon.com/blogs/apn/coreos-and-ticketmaster-col... Or for the ELB stuff and not the ALBs: https://github.com/sky-uk/feed https://github.com/sky-uk/feed
- bpineau 9y agoAt the very least, Kubernetes natively supports exposing Services (targeting an Ingress controller or otherwise) by configuring AWS ELBs when informed to run on AWS. All you have to do is using the "type: LoadBalancer" field in your Service's manifest. See https://kubernetes.io/docs/tasks/access-application-cluster/create-external-load-balancer/ https://kubernetes.io/docs/tasks/access-application-cluster/...
- achanda358 9y agoWhat does this mean for Kops? https://github.com/kubernetes/kops https://github.com/kubernetes/kops
- pm90 9y agoI'm guessing if you want your k8s cluster to be cloud-neutral, it would still be a good idea to have a tool like kops. But it will certainly reduce the number of people using it... which isn't a bad thing, really.
- dvdgsng 9y agoNot much really.
- meddlepal 9y agoSome teams will want custom cluster deployments for whatever reasons but it will probably lose a lot of traction now... which is fine. Kops is a big expansive tool with a little too much surface area for my liking in a infrastructure management tool. I'll be interested to know if EKS will support custom CNI or if it will use kubenet.
- jdc0589 9y agothey wrote their own cni to use AWS networking, much like kubenet. I haven't found details in if everything is encrypted in transit though; I REALLY hope it is.
- rbankston 9y agoThey announced they were going to be using their open source cni plugin https://github.com/aws/amazon-vpc-cni-k8s/ https://github.com/aws/amazon-vpc-cni-k8s/
- alexdrans 9y agoIf you had just convinced your CEO you need to hire a contractor to implement k8s on EC2 for your startup, what would you do now?
- gtirloni 9y agoIt depends on your deadlines. In the short-term, I would keep course and target a possible simplification in the automation code in the near future. EKS is still in preview and it doesn't seem like CloudFormation or Terraform support it yet.
- JohannesH 9y agoKeep going... EKS is still in preview, so you probably shouldn't rely on it in production just yet. However you could check out kops (https://github.com/kubernetes/kops https://github.com/kubernetes/kops), which makes provisioning a k8s cluster on AWS extremely easy. Good luck! :)
- srmatto 9y agoI'd highly, highly recommend using kube-aws over kops for AWS. Its far more transparent as it uses CloudFormation templates, though it does have a higher upfront time investment. Probably two hours as opposed to the 30 minutes or so that kops requires.
- kemitche 9y agoKops can emit terraform, FYI.
- s0l1dsnak3123 9y agoThat's how we've been migrating from our existing terraform-based infra to kubernetes. It made the transition of our staging environment relatively painless.
- srmatto 9y agoGood to know, thanks.
- k__ 9y agoIs there a reason why some of these services are called "AWS <servicename>" and some "Amazon <servicename>"?
- johneth 9y agoProbably because Amazon is bad at naming things.
- justonepost 9y agoMaybe Amazon <serviceName> aren't in the AWS org? I'm curious too though. Any amazonians to comment?
- querulous 9y agosame reason there's like nine distinct api protocols the various aws services use. teams just aren't coordinated at that level
- k__ 9y agoIs it better with GCP or Azure?
- manigandham 9y agoAzure is about the same, better in some areas and with the new CLI but plenty of confusing and badly named services. GCP is the best at standardization, but also the slowest at releasing updates and with the fewest services.
- k__ 9y agoI see. Yes, I already saw a tutorial for WebSocket stuff which relies on AWS IoT, whilw SNS sounded more fitting..
- Macha 9y agoWhy are there at least 3 ways to configure an emr cluster from a main file and many of the property names don't match? (data pipeline, cloud formation and emr's own syntax) Amazon's internal structure seems to leak a lot.
- iamdeedubs 9y agoVery excited to see this exit preview. I really hope this gets covered under the BAA and available in a HIPAA context.
- erikb 9y agoAh okay, here it is. First I thought this other release of a container engine would be it. Yeah that's "gg" for many cluster management providers.
- devj 9y agoAny idea how Kubo or Cloud Foundry Container Runtime(CFCR) fare against solutions like AKS, EKS, GKS, etc