4 ms·

Has anyone here a usecase which would perform better with this new S3 Express Tier? And a second question, would it be worth the 8x times surcharge?

parhamn 3y ago
I think the key benefit brushed on by this article is the potential 10x improvement in access speeds (which has many applications, beyond reducing your s3 op charges). > S3 Express One Zone can improve data access speeds by 10x and reduce request costs by 50% compared to S3 Standard and scales to process millions of requests per minute.
- haimez 3y ago
  10x reduction in latency, higher storage costs with lower access costs (SSD instead of spinning disks). So high I/O, small files situations (with no need for cross AZ access) are where the benefits can be found.
samtregar3 3y ago
[dead]
paulddraper 3y ago
A cache with large blobs (images, etc)
- awoimbee 3y ago
  If it's only a cache it should be on EBS, which is still way faster and 2x less expensive. I started a migration to s3 for such a project (container image caching) but then stopped when I realized what I was doing.
  - paulddraper 3y ago
    1. You'd need an access/authentication layer on top of that. 2. Variable throughput may be a concern. 3. You may have availability concerns.
  - rbranson 3y ago
    EBS attaches a single block storage volume to a single host[1]. S3 Express is a service-based object store. Apples and oranges. [1] Yes, I am aware of multi-attach but this introduces a scaling bottleneck and requires a fairly exotic setup.
  - YetAnotherNick 3y ago
    Yes, EBS is the gold standard but managing a EBS to scale up and down instantly, be available to multiple instances, lifecycle management, managing replica, switchover etc. are definitely not easy. And EBS are bad choice when throughput needed is very spiky.
barsandtones 3y ago
This will work great with the s3 mount point that AWS recently released. This will outperform EFS if your application does not require full POSIX compatibility.
maccard 3y ago
I'm going to set up sccache [0] to use it tomorrow. We use MSVC, so EFS is off the cards. [0] https://github.com/mozilla/sccache/blob/main/docs/S3.md https://github.com/mozilla/sccache/blob/main/docs/S3.md

parhamn 3y ago

I think the key benefit brushed on by this article is the potential 10x improvement in access speeds (which has many applications, beyond reducing your s3 op charges). > S3 Express One Zone can improve data access speeds by 10x and reduce request costs by 50% compared to S3 Standard and scales to process millions of requests per minute.

haimez 3y ago
10x reduction in latency, higher storage costs with lower access costs (SSD instead of spinning disks). So high I/O, small files situations (with no need for cross AZ access) are where the benefits can be found.

samtregar3 3y ago

[dead]

paulddraper 3y ago

A cache with large blobs (images, etc)

awoimbee 3y ago
If it's only a cache it should be on EBS, which is still way faster and 2x less expensive. I started a migration to s3 for such a project (container image caching) but then stopped when I realized what I was doing.
- paulddraper 3y ago
  1. You'd need an access/authentication layer on top of that. 2. Variable throughput may be a concern. 3. You may have availability concerns.
- rbranson 3y ago
  EBS attaches a single block storage volume to a single host[1]. S3 Express is a service-based object store. Apples and oranges. [1] Yes, I am aware of multi-attach but this introduces a scaling bottleneck and requires a fairly exotic setup.
- YetAnotherNick 3y ago
  Yes, EBS is the gold standard but managing a EBS to scale up and down instantly, be available to multiple instances, lifecycle management, managing replica, switchover etc. are definitely not easy. And EBS are bad choice when throughput needed is very spiky.

barsandtones 3y ago

This will work great with the s3 mount point that AWS recently released. This will outperform EFS if your application does not require full POSIX compatibility.

maccard 3y ago

I'm going to set up sccache [0] to use it tomorrow. We use MSVC, so EFS is off the cards. [0] https://github.com/mozilla/sccache/blob/main/docs/S3.md https://github.com/mozilla/sccache/blob/main/docs/S3.md