5 ms·
I had just this scenario yesterday where Google ran out of capacity of NVMe-based N1 hosts in a zone. I was forced to upgrade a large number of nodes to N2 host
by busterarm 6y ago
I had just this scenario yesterday where Google ran out of capacity of NVMe-based N1 hosts in a zone. I was forced to upgrade a large number of nodes to N2 hosts, which cost more (despite their claims about them being cheaper -- the sustained use discounts are lower) and are still in Beta.
I just wanted info before I started about whether we should expect to be able to even build those hosts that day and they wouldn't give us _anything_. We're not exactly a small company and the amount we're spending with them is large.
Their answer was basically either reserve capacity or screw you. I had to relay that to my CTO.
- martin_bech 6y agoGCP seems like its run like a hobby project. Scary af
- busterarm 6y agoIt's because unlike AWS and Azure, they don't actually use it.
- nautilus12 6y agoThat explains everything. Only sell what you yourself would find useful.
- stainforth 6y agoBut what about the Scarface rule: "Never get high on your own supply"?
- rexf 6y agoThe term is dogfooding
- CamperBob2 6y agoGood advice if you're selling sketchy street drugs. Not good advice if you're a software/services provider.
- nautilus12 6y agoGive me some of that sweet loadbalancer action. Its been like a week, i'm starting to lose it.
- q3k 6y agoGoogle tried with GAE, which is much closer to the Borg model (“I don't care about VMs, just run this code somewhere for me, and make it scale, make it automatically have access to a database”), but the world wasn't ready for it. The world wants VMs and virtual networks and firewalls and clickable web interfaces and to run big legacy enterprise apps that MUST NEVER DIE and to fuck around with Terraform and to SSH onto boxes. This sucks, though, and Google SREs know better than to use such terrible abstractions unless forced to. The internal software development ecosystem is eons ahead of anything you can get with any cloud provider, but that sort of alien technology doesn't sell. Kubernetes/GKE is a good compromise between something that Google sells but Google also wants to use. That, and some of the GCP versions of internal tools (Spanner, BigTable, BigQuery, ...).
- busterarm 6y agoThe world wants those things because they have vendor products they need to run and can't just write the software for every tool they'll ever need. We're all just living in the real world. What to Google looks like non-terrible abstractions looks like Kool Aid elsewhere.
- deleted 6y ago[deleted]
- martin_bech 6y agoThats actually it, and thereby it is a hobby project, that Google could close at any time..
- Thaxll 6y agoAWS does that as well, you think hardware is infinite? You will run out of instances type in any cloud provider, nothing new.
- busterarm 6y agoThe problem in that story wasn't them being oversubscribed; it was their communication.