3 ms·

Very cool! This makes Google the only major cloud that has low-latency single-zone object storage, standard regional object storage, and transparently-replicate

Very cool! This makes Google the only major cloud that has low-latency single-zone object storage, standard regional object storage, and transparently-replicated dual-region object storage - all with the same API. For infra systems, this is great: code against the GCS API, and let the user choose the cost/latency/durability tradeoffs that make sense for their use case.

dastbe 2y ago
? s3: https://aws.amazon.com/pm/serv-s3 https://aws.amazon.com/pm/serv-s3 s3 express: https://aws.amazon.com/s3/storage-classes/express-one-zone/ https://aws.amazon.com/s3/storage-classes/express-one-zone/ cross-region replication: https://docs.aws.amazon.com/AmazonS3/latest/userguide/replication.html https://docs.aws.amazon.com/AmazonS3/latest/userguide/replic...
- akshayshah 2y ago
  The cross-region replication I’ve seen for S3 (including the link you’ve provided) is fundamentally different from a dual-region GCS bucket. AWS is providing a way to automatically copy objects between distinct buckets, while GCS is providing a single bucket that spans multiple regions. It’s much, much easier to code against a dual-region GCS bucket because the bucket namespace and object metadata are strongly consistent across regions.
- jeffbee 2y ago
  The semantics they are offering are very different from S3. In Colossus a writer can make a durable 1-byte append and other observers are able to reason about the commit point. S3 does not offer this property.
  - dastbe 2y ago
    Sure, but that's not what the parent said.
korkybuchek 2y ago
> This makes Google the only major cloud that has low-latency single-zone object storage, standard regional object storage, Absurd claim. S3 Express launched last year.
- akshayshah 2y ago
  Sure, but AFAIK S3’s multi-region capabilities are quite far behind GCS’s. S3 offers some multi-region replication facilities, but as far as I’ve seen they all come at the cost of inconsistent reads - which greatly complicates application code. GCS dual-region buckets offer strongly consistent metadata reads across multiple regions, transparently fetch data from the source region where necessary, and offer clear SLAs for replication. I don’t think the S3 offerings are comparable. But maybe I’m wrong - I’d love more competition here! https://cloud.google.com/blog/products/storage-data-transfer/using-dual-region-buckets-in-google-cloud-storage https://cloud.google.com/blog/products/storage-data-transfer...
  - korkybuchek 2y ago
    > Sure, but AFAIK S3’s multi-region capabilities are quite far behind GCS’s. Entirely different claim.
    - akshayshah 2y ago
      I claimed that Google is the only major cloud provider with all three of: - single-zone object storage buckets - regional object storage buckets - transparently replicated, dual region object storage buckets I agree that AWS has two of the three. AFAIK AWS does not have multi-region buckets - the closest they have is canned replication between single-region buckets.
      - whatreason 2y ago
        not quite the same, but S3 does have https://aws.amazon.com/s3/features/multi-region-access-points/ https://aws.amazon.com/s3/features/multi-region-access-point..., which would let you treat multiple buckets in different regions as one single bucket (mostly). But you still do need to set up canned replication.

dastbe 2y ago

? s3: https://aws.amazon.com/pm/serv-s3 https://aws.amazon.com/pm/serv-s3 s3 express: https://aws.amazon.com/s3/storage-classes/express-one-zone/ https://aws.amazon.com/s3/storage-classes/express-one-zone/ cross-region replication: https://docs.aws.amazon.com/AmazonS3/latest/userguide/replication.html https://docs.aws.amazon.com/AmazonS3/latest/userguide/replic...

akshayshah 2y ago
The cross-region replication I’ve seen for S3 (including the link you’ve provided) is fundamentally different from a dual-region GCS bucket. AWS is providing a way to automatically copy objects between distinct buckets, while GCS is providing a single bucket that spans multiple regions. It’s much, much easier to code against a dual-region GCS bucket because the bucket namespace and object metadata are strongly consistent across regions.
jeffbee 2y ago
The semantics they are offering are very different from S3. In Colossus a writer can make a durable 1-byte append and other observers are able to reason about the commit point. S3 does not offer this property.
- dastbe 2y ago
  Sure, but that's not what the parent said.

korkybuchek 2y ago

> This makes Google the only major cloud that has low-latency single-zone object storage, standard regional object storage, Absurd claim. S3 Express launched last year.

akshayshah 2y ago
Sure, but AFAIK S3’s multi-region capabilities are quite far behind GCS’s. S3 offers some multi-region replication facilities, but as far as I’ve seen they all come at the cost of inconsistent reads - which greatly complicates application code. GCS dual-region buckets offer strongly consistent metadata reads across multiple regions, transparently fetch data from the source region where necessary, and offer clear SLAs for replication. I don’t think the S3 offerings are comparable. But maybe I’m wrong - I’d love more competition here! https://cloud.google.com/blog/products/storage-data-transfer/using-dual-region-buckets-in-google-cloud-storage https://cloud.google.com/blog/products/storage-data-transfer...
- korkybuchek 2y ago
  > Sure, but AFAIK S3’s multi-region capabilities are quite far behind GCS’s. Entirely different claim.
  - akshayshah 2y ago
    I claimed that Google is the only major cloud provider with all three of: - single-zone object storage buckets - regional object storage buckets - transparently replicated, dual region object storage buckets I agree that AWS has two of the three. AFAIK AWS does not have multi-region buckets - the closest they have is canned replication between single-region buckets.
    - whatreason 2y ago
      not quite the same, but S3 does have https://aws.amazon.com/s3/features/multi-region-access-points/ https://aws.amazon.com/s3/features/multi-region-access-point..., which would let you treat multiple buckets in different regions as one single bucket (mostly). But you still do need to set up canned replication.