4 ms·
> Do you think management nodes are free? ... Google['s management nodes] might be free Indeed they are. Why do you think that is? It could be that they're a
by derefr 8y ago
> Do you think management nodes are free? ... Google['s management nodes] might be free
Indeed they are. Why do you think that is?
It could be that they're a great big loss-leader for GKE, or that the costs of GKE management nodes are amortized into the per-cluster-node costs. But neither of these seem to be true. (The pricing of GKE management nodes before they made them free was negligible; and GKE nodes don't cost any more than equivalent GCE nodes.)
The real answer, I think, is that K8s management nodes really are just not all that big a deal to run. Certainly not $144/mo of a big deal.
- puzzle 8y agoLast time I checked, Google's public renewable energy footprint was 2x Amazon's, as a proximate for the actual footprint, so it's not that crazy to imagine that there are plenty of slack resources to run small VMs or even Borg tasks for these masters.
- manigandham 8y agoAWS is 10x larger than GCP so power and compute capacity are really not the issue here, especially for a product that just launched. There's also no reason AWS couldn't adopt the same lightweight kubernetes master processes that GKE uses after all this time.
- yebyen 8y ago> public renewable energy footprint When electricity is the sole marginal cost of keeping a node powered up from your pool of available machines that can be powered on and off on-demand, these particular words actually mean a lot. I think the point is that GCP can afford to keep some nodes online even when they don't belong to anyone and just eat the cost. (Eg. those renewable resources like wind and the sun just don't cost anything, so why not spend the energy that is generated from them.) I'm sure I'm not giving AWS enough credit. Seeing that Google pretty much invented Kubernetes, their cost to come 'up to speed' enough to provide a managed version of it is effectively nil. Their renewable energy is not the only source of so-called "extra capacity," either... they honestly should have had no trouble staffing a team to build out and promote GKE without siphoning off much more than a nominal amount of developer capacity from other offerings that may need it as well. If it's true that when AWS announced they'd be offering EKS last November, they only had a team of 5 allocated to it, then I guess they deserve a lot of credit for the progress they've made in about 8 months. That cost to AWS is non-zero (I'm also pretty sure the team has grown and is larger than 5 devs now) and they have every reasonable basis to attempt to recoup it. I don't think many AWS customers will disagree. The adopters who have known they need it for a year or more, many who are happily locked into the ecosystem already, will certainly be lining up to pay for this now.
- puzzle 8y agoA more accurate point is not necessarily that Google will keep some more nodes up, but that it can fit small workloads like a Kubernetes master into existing nodes that run other stuff and have bits of spare capacity. Borg's resource estimation is pretty good at squeezing things. I'm thinking specifically of masters for smaller clusters, where the fixed overhead costs of the control plane are relatively high compared to the node count. On larger clusters, the masters will be beefier, sure, but your customer will be paying for enough nodes to make up for their cost and the fixed overhead is more "diluted".
- puzzle 8y agoAWS might be larger than GCP, but the rest of Google (Search, Adwords, Adsense, YT, Gmail, Maps, Apps, etc.) is larger than all of AWS+Amazon and that's the kind of resources over which Google can amortize things. https://electrek.co/2017/11/30/google-is-officially-100-sun-and-wind-powered-3-0-gigawatts-worth/ https://electrek.co/2017/11/30/google-is-officially-100-sun-... Google has been running almost everything, GCP included, under Borg and can squeeze mixed workloads more tightly than the industry average. My understanding is that Amazon's technology is less uniform, but perhaps they have improved things and thus increased their utilization. You are basically printing money when it goes up by even just 1%. Or you can afford to hand out freebies like Kubernetes masters, since they're lost in the noise.
- perlin 8y agoSpeaking of capacity, I just got this error trying to build an EKS cluster. UnsupportedAvailabilityZoneException: Cannot create cluster because us-east-1b, the targeted availability zone, does not currently have sufficient capacity to support the cluster. Retry and choose from these availability zones: us-east-1a, us-east-1c, us-east-1d But yeah, sure, keep telling yourself the AWS doesn't have a problem with power and compute capacity. Or maybe it's just poor product design? https://docs.aws.amazon.com/eks/latest/userguide/troubleshooting.html https://docs.aws.amazon.com/eks/latest/userguide/troubleshoo... They should've called it Generally Available(ish)
- derefr 8y agoThe availability zones in us-east-1 have unique legacy problems related to companies that would select one AZ and deploy all their huge amount of infrastructure to it. IIRC, Netflix did this, for one example. Every company that did this was picking us-east-1a specifically, because it was the first AZ in the list. It added up, and now the us-east-1a datacenter can't add capacity fast enough to support the growth of all the companies "stuck" on it (because their existing infra is already deployed there, and they still need to grow.) Effectively, us-east-1a is "full." Which means, of course, that companies would find out from friends or from AWS errors that us-east-1a is full, and so choose us-east-1b... AWS fixed this a few years in by making the AZs in a region randomized respective to an AWS root account (so my AWS account's us-east-1a is your AWS account's us-east-1{b,c,d}.) So new companies were better "load balanced" onto the AZs of a region. But, because those companies still exist and are still growing on the specific DC that was us-east-1a (and to a lesser extent us-east-1b), those DCs are still full. So, for any given AWS account, one-and-a-half of the AZs in us-east-1 will be hard to deploy anything to. Suggestions: • for greenfield projects, just use us-east-2. • for projects that need low-latency links to things that are already deployed within us-east-1, run some reservation actions to see how much capacity you can grab within each us-east-1 AZ, which will let you determine which of your AZs map to the DCs previously known as us-east-1a and us-east-1b. Then, use the other ones. (Or, if you're paying for business-level support, just ask AWS staff which AZs those are for your account; they'll probably be happy to tell you.)
- alpb 8y agoGoogle Kubernetes Engine has announced general availability (GA) of "free" highly-available (HA) control plane support yesterday. You can read more here: https://cloudplatform.googleblog.com/2018/06/Regional-clusters-in-Google-Kubernetes-Engine-are-now-generally-available.html https://cloudplatform.googleblog.com/2018/06/Regional-cluste... disclaimer: I work at Google.
- puzzle 8y agoIsn't it funny how Google announces free GKE stuff the day before EKS was announced AND made generally available? :-) Like Jobs issuing a press release that the App Store had hit 3B downloads the morning of the Nexus One launch.
- TheIronYuppie 8y agoI would agree with you, but no one (honestly) knew when EKS was being announced at GA, including customers we talked to. I think this was just a coincidence. Disclosure: I work at Google.
- yebyen 8y agoI'd speculate that Google did it on purpose the first time (everyone knew there had to be an announcement coming, and the date of re:Invent was well known in advance.) Given what some are saying in this thread here today, I would not be the least bit surprised to learn that Google's announcement this time actually forced Amazon's hand, and that the folks on this afternoon's Amazon's twitch stream actually found out yesterday that they'd be making the announcement today. (Sure, I'd be speculating, but fight me.)
- puzzle 8y agoYeah, it was safe to assume they would announce something related at re:Invent, given that they had joined the CNCF a few months before, after simply ignoring Kubernetes for years.
- iampims 8y agoIt’s subsidized by AdSense. Like every Google product.
- manigandham 8y agoWhy wouldn't Amazon do the same then when they have a higher market cap than Google and a known reputation to loss-lead an entire vertical to the tune of 100s of millions just to put a competitor out of business?
- rad_gruchalski 8y agoWhy would they? Companies will pay anyway. It’s a no cost for deployments in 1000s of $$$ / month.
- manigandham 8y agoThis sub-thread was about AWS not having the same resource efficiency as Google, and Google also subsidizing with AdSense which is why GKE is free. So in that sense there is no reason why AWS couldnt also make them free. Not every deployment is $1000s/month. I dont care about EKS, but it will hurt adoption if every single cluster requires a $144/month fee for the master when there are offerings from GCP and Azure that are free and far more polished.
- rad_gruchalski 8y ago> Not every deployment is $1000s/month. I dont care about EKS, but it will hurt adoption if every single cluster requires a $144/month fee for the master when there are offerings from GCP and Azure that are free and far more polished. Maybe that's the reasoning behind it. If the service isn't really up to standard yet, it definitely makes sense. Smaller players, when they see an unfinished product, will not come back. Keep the small clients away until the service is more polished by price barring, use the bigger clients who can afford the support, iterate and improve. Time will tell.