5 ms·
TL;DR: 1. Cloud Bigtable is GA [0] 2. Cloud Datastore GA [1] 3. Cloud SQL 2.0 GA [2] 4. Persistent Disk SSD now gets 25,000 IOPS [3] 5. SQL Server images a
by vgt 10y ago
TL;DR:
1. Cloud Bigtable is GA [0]
2. Cloud Datastore GA [1]
3. Cloud SQL 2.0 GA [2]
4. Persistent Disk SSD now gets 25,000 IOPS [3]
5. SQL Server images available [3]
6. Custom Encryption Keys in Google Cloud Storage [3]
7. Google Nearline Storage access latency now real-time [3]
POV:
- Bigtable can reach some serious scale for Hbase-style workloads (ex: Sungard got 34m reads per second and 23m writes per second[4] ).
- Datastore serves almost 6m qps on average [1]
- Cloud SQL 2.0 compares favorably against AWS RDS and Aurora [2]
- Persistent Disk SSD compares favorably against options in the marketplace[5]
- Nearline is archival storage with real-time access characteristics
[0] (https://cloudplatform.googleblog.com/2016/08/Google-Cloud-Bigtable-is-generally-available-for-petabyte-scale-NoSQL-workloads.html https://cloudplatform.googleblog.com/2016/08/Google-Cloud-Bi...)
[1] (https://cloudplatform.googleblog.com/2016/08/google-cloud-datastore-serves-over-15.html https://cloudplatform.googleblog.com/2016/08/google-cloud-da...)
[2] (https://cloudplatform.googleblog.com/2016/08/Cloud-SQL-Second-Generation-performance-and-feature-deep-dive.html https://cloudplatform.googleblog.com/2016/08/Cloud-SQL-Secon...)
[3] (https://cloudplatform.googleblog.com/2016/08/why-Google-Cloud-Platform-is-ready-for-your-enterprise-database-workloads.html https://cloudplatform.googleblog.com/2016/08/why-Google-Clou...)
[4] (https://cloudplatform.googleblog.com/2016/03/financial-services-firm-processes-25-billion-stock-market-events-per-hour-with-Google-Cloud-Bigtable.html https://cloudplatform.googleblog.com/2016/03/financial-servi...)
[5] (https://medium.com/google-cloud/new-google-cloud-ssds-have-amazing-price-to-performance-2a58e7d9b433#.3ckq4e4iz https://medium.com/google-cloud/new-google-cloud-ssds-have-a...)
(Disc: work on Google Cloud)
- jhgg 10y agoDoes the SSD iops increase happen automatically? Or do we have to turn it on somewhere or recreate the disk? Also any plan to allow objects in GCS bucket to automatically move to nearline after a specified time, like s3 to glacier?
- thesandlord 10y agoShould be automatic. Remember your max IOPS are also limited by core count. https://cloud.google.com/compute/docs/disks/performance#relationship_between_size_and_performance https://cloud.google.com/compute/docs/disks/performance#rela...
- rybosome 10y agoYou can use the Storage Transfer Service[0] to automatically move objects past a certain age from one GCS bucket to another. [0]: https://cloud.google.com/storage/transfer/ https://cloud.google.com/storage/transfer/
- crypto5 10y ago> ex: Sungard got 34m reads per second and 23m writes per second[4] Interesting how fast they drained money with such traffic..
- joncampbelldev 10y agoI'm not sure if its completely favourable for cloud sql to perform worse than aurora when the thread count goes above 16. Seems like two different use cases are being targetted: Aurora for consistent performance as concurrent users/queries increase (but sacrificing speed at the small scale). Cloud sql for high performance on less concurrent workloads.
- user5994461 10y agoThey both perform significantly faster than RDS MySQL. That's probably the lesson here. SQL connection pools are configurable in the application. When you care about performances, you have to do benchmarking to find the optimal number of concurrent threads for the specific load. It's noteworthy to see that google has a consistent total of queries per seconds (the average per thread drops almost linearly when adding threads), whereas RDS Aurora is exhibiting variable throughput and flat areas. Consistency > Raw Performances
- clebio 10y agoWould love a citation for this -- benchmarks or such (of course I could lmgtfy for myself...).
- user5994461 10y agoRight. The gem was hidden in the big pile of articles. You're looking for this graph: https://cloudplatform.googleblog.com/2016/08/why-Google-Cloud-Platform-is-ready-for-your-enterprise-database-workloads.html https://cloudplatform.googleblog.com/2016/08/why-Google-Clou...