4 ms·

Some related reading - * Jeff Barr's blog post on this topic, has an interesting case study: https://aws.amazon.com/blogs/aws/amazon-s3-update-strong-read-aft

by jz-amz 6y ago

Some related reading - * Jeff Barr's blog post on this topic, has an interesting case study: https://aws.amazon.com/blogs/aws/amazon-s3-update-strong-read-after-write-consistency/ https://aws.amazon.com/blogs/aws/amazon-s3-update-strong-rea... * Collaboration with Hadoop/S3A maintainers leading to this release: https://aws.amazon.com/blogs/opensource/community-collaboration-the-s3a-story/ https://aws.amazon.com/blogs/opensource/community-collaborat...

yftsui 6y ago
I am curious about how much Dropbox pays for data ingress/egress, they migrated storage to their own on premise data center, then now moving data back to S3 for the data lake.
- Scaevolus 6y ago
  That's analytics data, not file storage. If they have 34PB of analytics, they certainly have far more than that of blob storage.
  - SteveNuts 6y ago
    I thought they were almost entirely on prem for the actual storage
    - ddorian43 6y ago
      See https://github.com/rockset/rocksdb-cloud https://github.com/rockset/rocksdb-cloud
  - deleted 6y ago
    [deleted]
  - ashish-gandhi 6y ago
    Definitely much more of user data storage. More about that https://dropbox.tech/infrastructure/inside-the-magic-pocket https://dropbox.tech/infrastructure/inside-the-magic-pocket. Happy to take other questions.
    - qt_scientist 6y ago
      Did you consider building a S3 API in front of Magic Pocket so it could also serve as your analytics storage? Or is your compute so bursty that it's more beneficial to be in the cloud on EC2 than to host on prem compute in front of Magic Pocket?
- bboreham 6y ago
  Amazon has hard-disk products for large transfers. Snowcone, Snowball and Snowmobile.