6 ms·

Viewing Sizing Recommendations for Instances

74 points by vgt 10y ago

markwaldron 10y ago
Does GCE have the ability to automatically resize based on the recommendations?
- dvcrn 10y ago
  not automatically because the machine needs to get restarted. Can't do that with a production app
  - homerguy69 10y ago
    If your production services are properly balanced it should be possible. Not sure if the functionality is available.
    - brianwawok 10y ago
      It is not. Not sure this is the right way to do it anyway.
ken47 10y ago
Google Cloud gets a +1 for this. When a big corp does the right thing for its customers, they take notice.
- s3v3n 10y ago
  AWS has had this for a while.
- kyrra 10y ago
  AWS I think has something similar, but I'm not sure it's the same, CloudWatch[0]. Cloudwatch giving alerting and can kill underutilized instances. But this sizing feature from GCP seems to allow for instance resizing rather than just deletion. As far as why this may benefit google: while a customer will pay the same regardless, that means there are less resources in GCPs overall pool of potential machines that others can use. And to support the overall capacity of all their customers, Google needs more machines to handle them all. I'm guessing Google would rather have most of their machines active, as building out less racks/datacenters is probably better for the bottom-line overall. [0] https://aws.amazon.com/cloudwatch/details/ https://aws.amazon.com/cloudwatch/details/
- vasco 10y ago
  "Trusted Advisor" on the AWS Console has been doing this for a long time, for several types of under-utilized, not only instances. Not only this but it also notifies you when you're reaching default limits so you can put in a support request for limit increase before you hit them.
  - user5994461 10y ago
    You gotta pay 10% on top of your bill to have Trusted Advisor. (that's part of the pro support plan). Last I checked there was no advice on instance size. I've seen one or two, nothing meaningful. There are lots of advice for reserving instances though, and they are extremely poor. Listening to them would be a good way for us to waste $10k/month :D
  - sciurus 10y ago
    The checks and recommendations aren't very sophisticated, though. E.G. the Low Utilization Amazon EC2 Instances check: Checks the Amazon Elastic Compute Cloud (Amazon EC2) instances that were running at any time during the last 14 days and alerts you if the daily CPU utilization was 10% or less and network I/O was 5 MB or less on 4 or more days.
amelius 10y ago
Why not automatically give me my money back when my VMs are underutilized? :)
- mikecb 10y ago
  Well, they do do automatic discounts for long-running instances, rather than reservations...
- hueving 10y ago
  Because the reserved resources were not available for other customers.
  - amelius 10y ago
    That needs fixing then :)
dasmoth 10y ago
This makes me a little nervous. The linked page admits that sometimes there are good reasons for machines to look "underused", but how much luck am I going to have explaining that to a bean counter who thinks he's seen a way to save some money.
- vgt 10y ago
  You can opt out of the service
- snambi 10y ago
  Its just a recommendation, Not action.
- Johnny555 10y ago
  If the bean counter is making hardware decisions for the Operations team, then the company deserves what it gets.
snambi 10y ago
Eventually google is going to disrupt the cloud industry, just like how they disrupted the Ad industry by having analytics and providing users with right price and catering to their exact needs.
- balls187 10y ago
  That seems very doubtful. Google started with a dominant search platform. They don't have that luxury with Cloud. Google used to have a near monopoly on solving hard CS problems, with an army of very very very smart CS grads. They could produce software that no other company could. These days, many other companies have invested in growing their army of top tier CS devs, and so they are able to make software equally as impressive.
  - vgt 10y ago
    While advantage Google has enjoyed is slimmer, I think it's a fallacy to think that technology has been commoditized. Slight oversimplification, but Google's had basically S3/GCS and Hadoop since early 2000s, and basically Docker + Kubernetes for the past 10. This translates into real-world edge. For example, how many big data tools have any one of the 15 characteristics of BigQuery that I described at [0]? Or how many companies have inter-data center networking that gives you a Petabit of bisectional bandwidth, described at [1], or how many cloud providers have live migration, custom VMs, or insane RAM-like local SSD? Or how many PaaS offerings can sustain a behemoth like Snapchat? Or a NoSQL that scales to 56 million qps with just a handful of engineers [2] ?? Edit: To add more color. In days past, Google would release papers (GFS, MapReduce, Bigtable, etc). With Google Cloud Platform we can just externalize these services (with a bit of customer-friendly bits like isolation, pricing, etc). Bigtable, BigQuery (Dremel), PubSub to name a few. (clearly biased, since I work at Google) [0]https://medium.com/p/6654841fa2dc https://medium.com/p/6654841fa2dc [1]https://cloudplatform.googleblog.com/2015/06/A-Look-Inside-Googles-Data-Center-Networks.html https://cloudplatform.googleblog.com/2015/06/A-Look-Inside-G... [2]https://cloudplatform.googleblog.com/2016/03/financial-services-firm-processes-25-billion-stock-market-events-per-hour-with-Google-Cloud-Bigtable.html https://cloudplatform.googleblog.com/2016/03/financial-servi...
_wmd 10y ago
> During Beta, sizing recommendations are available free of charge. However, Google might charge for this feature in future releases Heh. "We've established enough foothold to compete with EC2 therefore we're preparing to pull an App Engine
- thesandlord 10y ago
  This is the standard banner for alpha/beta services. Some become permanently free once they go GA (i.e Cloud Shell) while others become paid (i.e Cloud Vision API) I work for Google Cloud.
triplebit 10y ago
Bandwidth pricing for small operations, bandwidth pricing, bandwidth pricing.
user5994461 10y ago
Google Cloud 1 - Amazon AWS 0

74 points by vgt 10y ago

markwaldron 10y ago

Does GCE have the ability to automatically resize based on the recommendations?

dvcrn 10y ago
not automatically because the machine needs to get restarted. Can't do that with a production app
- homerguy69 10y ago
  If your production services are properly balanced it should be possible. Not sure if the functionality is available.
  - brianwawok 10y ago
    It is not. Not sure this is the right way to do it anyway.

ken47 10y ago

Google Cloud gets a +1 for this. When a big corp does the right thing for its customers, they take notice.

s3v3n 10y ago
AWS has had this for a while.
kyrra 10y ago
AWS I think has something similar, but I'm not sure it's the same, CloudWatch[0]. Cloudwatch giving alerting and can kill underutilized instances. But this sizing feature from GCP seems to allow for instance resizing rather than just deletion. As far as why this may benefit google: while a customer will pay the same regardless, that means there are less resources in GCPs overall pool of potential machines that others can use. And to support the overall capacity of all their customers, Google needs more machines to handle them all. I'm guessing Google would rather have most of their machines active, as building out less racks/datacenters is probably better for the bottom-line overall. [0] https://aws.amazon.com/cloudwatch/details/ https://aws.amazon.com/cloudwatch/details/
vasco 10y ago
"Trusted Advisor" on the AWS Console has been doing this for a long time, for several types of under-utilized, not only instances. Not only this but it also notifies you when you're reaching default limits so you can put in a support request for limit increase before you hit them.
- user5994461 10y ago
  You gotta pay 10% on top of your bill to have Trusted Advisor. (that's part of the pro support plan). Last I checked there was no advice on instance size. I've seen one or two, nothing meaningful. There are lots of advice for reserving instances though, and they are extremely poor. Listening to them would be a good way for us to waste $10k/month :D
- sciurus 10y ago
  The checks and recommendations aren't very sophisticated, though. E.G. the Low Utilization Amazon EC2 Instances check: Checks the Amazon Elastic Compute Cloud (Amazon EC2) instances that were running at any time during the last 14 days and alerts you if the daily CPU utilization was 10% or less and network I/O was 5 MB or less on 4 or more days.

amelius 10y ago

Why not automatically give me my money back when my VMs are underutilized? :)

mikecb 10y ago
Well, they do do automatic discounts for long-running instances, rather than reservations...
hueving 10y ago
Because the reserved resources were not available for other customers.
- amelius 10y ago
  That needs fixing then :)

dasmoth 10y ago

This makes me a little nervous. The linked page admits that sometimes there are good reasons for machines to look "underused", but how much luck am I going to have explaining that to a bean counter who thinks he's seen a way to save some money.

vgt 10y ago
You can opt out of the service
snambi 10y ago
Its just a recommendation, Not action.
Johnny555 10y ago
If the bean counter is making hardware decisions for the Operations team, then the company deserves what it gets.

snambi 10y ago

Eventually google is going to disrupt the cloud industry, just like how they disrupted the Ad industry by having analytics and providing users with right price and catering to their exact needs.

balls187 10y ago
That seems very doubtful. Google started with a dominant search platform. They don't have that luxury with Cloud. Google used to have a near monopoly on solving hard CS problems, with an army of very very very smart CS grads. They could produce software that no other company could. These days, many other companies have invested in growing their army of top tier CS devs, and so they are able to make software equally as impressive.
- vgt 10y ago
  While advantage Google has enjoyed is slimmer, I think it's a fallacy to think that technology has been commoditized. Slight oversimplification, but Google's had basically S3/GCS and Hadoop since early 2000s, and basically Docker + Kubernetes for the past 10. This translates into real-world edge. For example, how many big data tools have any one of the 15 characteristics of BigQuery that I described at [0]? Or how many companies have inter-data center networking that gives you a Petabit of bisectional bandwidth, described at [1], or how many cloud providers have live migration, custom VMs, or insane RAM-like local SSD? Or how many PaaS offerings can sustain a behemoth like Snapchat? Or a NoSQL that scales to 56 million qps with just a handful of engineers [2] ?? Edit: To add more color. In days past, Google would release papers (GFS, MapReduce, Bigtable, etc). With Google Cloud Platform we can just externalize these services (with a bit of customer-friendly bits like isolation, pricing, etc). Bigtable, BigQuery (Dremel), PubSub to name a few. (clearly biased, since I work at Google) [0]https://medium.com/p/6654841fa2dc https://medium.com/p/6654841fa2dc [1]https://cloudplatform.googleblog.com/2015/06/A-Look-Inside-Googles-Data-Center-Networks.html https://cloudplatform.googleblog.com/2015/06/A-Look-Inside-G... [2]https://cloudplatform.googleblog.com/2016/03/financial-services-firm-processes-25-billion-stock-market-events-per-hour-with-Google-Cloud-Bigtable.html https://cloudplatform.googleblog.com/2016/03/financial-servi...

_wmd 10y ago

> During Beta, sizing recommendations are available free of charge. However, Google might charge for this feature in future releases Heh. "We've established enough foothold to compete with EC2 therefore we're preparing to pull an App Engine

thesandlord 10y ago
This is the standard banner for alpha/beta services. Some become permanently free once they go GA (i.e Cloud Shell) while others become paid (i.e Cloud Vision API) I work for Google Cloud.

triplebit 10y ago

Bandwidth pricing for small operations, bandwidth pricing, bandwidth pricing.

user5994461 10y ago

Google Cloud 1 - Amazon AWS 0