7 ms·

S3's costs are insane for this use case, can't imagine using it to for a Linux distribution's repositories. edit: Oh man, there's potentially a $32k migration

S3's costs are insane for this use case, can't imagine using it to for a Linux distribution's repositories. edit: Oh man, there's potentially a $32k migration fee to pay for S3 egress, as well.

bombcar 3y ago
At least use one of those s3 competitors with sane pricing. GitHub? backblaze? Cloud flare?
- mkl 3y ago
  > same pricing I think you meant "sane"? Otherwise there's not much point in switching.
  - bombcar 3y ago
    Yeah, that was an unfortunate typo.
    - sitkack 3y ago
      Some things can only be said as a joke or by accident or both.
scottlamb 3y ago
"We will cover egress and migration fees for customers migrating over 10 TB of data from US, Canada, and Europe regions, and storing it with us for at least 12 months." - https://www.backblaze.com/b2/c2c-migration.html https://www.backblaze.com/b2/c2c-migration.html Also free egress from Backblaze to CDNs (Cloudflare or Fastly).
pxc 3y ago
> Oh man, there's potentially a $32k migration fee to pay for S3 egress, as well. I've known about this for a while, but never bothered to ask. Why is that kind of fee even legal? Is there anything pro-social or valuable about that kind of business practice?
- Waterluvian 3y ago
  They should rebrand it Data Impound Lot.
  - hyperliner 3y ago
    [dead]
- irjustin 3y ago
  I know we want to jump to hating aws but is there any info on the breakdown of this? Like who is charging the amount? Is it all aws or is there a cloudflare portion? Part of it is paying an engineer's time? How much data is being transferred? If it was pure egress fees then it's roughly ~350tb of data?
  - pizzafeelsright 3y ago
    $0.12 per gb Four grand. It can be done cheaper over time.
- driverdan 3y ago
  Why would it be illegal? You agree to it when you sign up for the service. Don't like it? Don't use the service.
- dilyevsky 3y ago
  Why would that be illegal? That’s just normal egress fee x GB stored. This is known in advance so anyone storing so much data in cloud is willingly putting themselves in this position
- ArchD 3y ago
  Outbound traffic from S3 is not free. If the data is emigrating, of course you need some outbound traffic.
  - sitkack 3y ago
    Why doesn't it cost to go in?
mythz 3y ago
Hopefully France is successful in suing AWS for their anti competitive Egress fees. Either way we've avoided any potential land mines like this by switching to Cloudflare R2.
- sitkack 3y ago
  Why just AWS, Google leases dark fiber to the other telcos, it basically runs the entire internet. That it charges egress fees at all is kinda nuts. They make 100% profit (more) on your egress from GCP.
- supriyo-biswas 3y ago
  Ofcom in the UK has proposed an investigation of the big three cloud providers' services for high egress fees[1]. [1] https://www.ofcom.org.uk/news-centre/2023/ofcom-proposes-to-refer-uk-cloud-market-for-investigation https://www.ofcom.org.uk/news-centre/2023/ofcom-proposes-to-...
quickthrower2 3y ago
I don’t know much about NixOS but I imagine the data in those buckets exists elsewhere? There could be a community effort to push data to the new provider and avoid the egress fee (or some of it)?
dinvlad 3y ago
There’s a Snowball device for this kind of migration, which would be much cheaper.
1letterunixname 3y ago
AWS Snowball (export) is $30/day (10 day minimum) + $30/TiB
- greyface- 3y ago
  And for just $12,500, you can keep the device instead of returning it!

S3's costs are insane for this use case, can't imagine using it to for a Linux distribution's repositories. edit: Oh man, there's potentially a $32k migration fee to pay for S3 egress, as well.

bombcar 3y ago

At least use one of those s3 competitors with sane pricing. GitHub? backblaze? Cloud flare?

mkl 3y ago
> same pricing I think you meant "sane"? Otherwise there's not much point in switching.
- bombcar 3y ago
  Yeah, that was an unfortunate typo.
  - sitkack 3y ago
    Some things can only be said as a joke or by accident or both.

scottlamb 3y ago

"We will cover egress and migration fees for customers migrating over 10 TB of data from US, Canada, and Europe regions, and storing it with us for at least 12 months." - https://www.backblaze.com/b2/c2c-migration.html https://www.backblaze.com/b2/c2c-migration.html Also free egress from Backblaze to CDNs (Cloudflare or Fastly).

pxc 3y ago

> Oh man, there's potentially a $32k migration fee to pay for S3 egress, as well. I've known about this for a while, but never bothered to ask. Why is that kind of fee even legal? Is there anything pro-social or valuable about that kind of business practice?

Waterluvian 3y ago
They should rebrand it Data Impound Lot.
- hyperliner 3y ago
  [dead]
irjustin 3y ago
I know we want to jump to hating aws but is there any info on the breakdown of this? Like who is charging the amount? Is it all aws or is there a cloudflare portion? Part of it is paying an engineer's time? How much data is being transferred? If it was pure egress fees then it's roughly ~350tb of data?
- pizzafeelsright 3y ago
  $0.12 per gb Four grand. It can be done cheaper over time.
driverdan 3y ago
Why would it be illegal? You agree to it when you sign up for the service. Don't like it? Don't use the service.
dilyevsky 3y ago
Why would that be illegal? That’s just normal egress fee x GB stored. This is known in advance so anyone storing so much data in cloud is willingly putting themselves in this position
ArchD 3y ago
Outbound traffic from S3 is not free. If the data is emigrating, of course you need some outbound traffic.
- sitkack 3y ago
  Why doesn't it cost to go in?

mythz 3y ago

Hopefully France is successful in suing AWS for their anti competitive Egress fees. Either way we've avoided any potential land mines like this by switching to Cloudflare R2.

sitkack 3y ago
Why just AWS, Google leases dark fiber to the other telcos, it basically runs the entire internet. That it charges egress fees at all is kinda nuts. They make 100% profit (more) on your egress from GCP.
supriyo-biswas 3y ago
Ofcom in the UK has proposed an investigation of the big three cloud providers' services for high egress fees[1]. [1] https://www.ofcom.org.uk/news-centre/2023/ofcom-proposes-to-refer-uk-cloud-market-for-investigation https://www.ofcom.org.uk/news-centre/2023/ofcom-proposes-to-...

quickthrower2 3y ago

I don’t know much about NixOS but I imagine the data in those buckets exists elsewhere? There could be a community effort to push data to the new provider and avoid the egress fee (or some of it)?

dinvlad 3y ago

There’s a Snowball device for this kind of migration, which would be much cheaper.

1letterunixname 3y ago

AWS Snowball (export) is $30/day (10 day minimum) + $30/TiB

greyface- 3y ago
And for just $12,500, you can keep the device instead of returning it!