3 ms·

For one, you only get billed for outgoing traffic from AWS. So if all your infra is on AWS, you're not paying for that. Secondly the ease of use is a lot compar

by Macha 5y ago

For one, you only get billed for outgoing traffic from AWS. So if all your infra is on AWS, you're not paying for that. Secondly the ease of use is a lot compared to back when you had to buy a bunch of servers to put hard drives in - remember s3 was one of the first aws services, alongside ec2. If your load wasn't high, cause you're a startup or whatever, then paying the extra premium on the storage to save the engineering effort of building your own storage cluster worked out. Then when you were big, those egress costs had you locked out. Plus add in thoughts about having to maintain infra vs aws do it for you and you had a lot of developer blogs/marketing sites of tech companies/whatever just serve on s3 since it was easy to use and the absolute cost for such a product is low enough that they didn't care about the relative cost of s3 vs other services.

tommek4077 5y ago
Virtual servers are a thing since ... forever on the Internet. At least since mid-nineties you had not to think about getting hard drives into servers, if you would not wanted to.
- Macha 5y ago
  VPSes were usually not cost effective either if what you wanted was a big pool of storage space. The big growth opportunity for S3 was the companies that would otherwise run their own SANs, not the startup that was going to run on a couple of VPSes or shared hosting otherwise. Even the startups that grew, they might start on a VPS provider, but outgrow them. S3 managed to scale with them and retain them as customers.
- acdha 5y ago
  Yes, and that's like saying that you don't understand why people eat at restaurants when there's field full of cauliflower. If you're comparing it to S3, using virtual servers means you're now taking on responsibility for configuring, operating, and securing replicated file storage in at least 3 geographically separated regions, scaling it when you start to fill up those local disks, building an API on top of that, and providing web-based access. Don't forget things like bitrot detection and prevention, storage encryption, centralized logging, event-based triggers, lifecycle management policies, tiering onto cheaper storage either by policy or automatically. For many organizations, the 24x7 staffing needed to provide an equivalent service alone would pay for their entire storage cost multiple times over. Even if your scale is sufficient to allow beating that, you are likely to have more compelling problems for that time to be spent on. (This is not saying that the egress charges are great, only that I completely understand why many, many people decided it was an acceptable tradeoff)
hinkley 5y ago
I suspect Cloudflare and any clones could set up their peering agreements with Cloud providers in such a way that they're exposed as a feature. First tier Cloud providers probably won't bite because it would open the door to people migrating out of their data centers. Second tier Cloud providers would eat that up, since it would democratize things more. Even if a competitor gets the customer, at least it's not the guy who is waging a war of attrition against you.
zerocrates 5y ago
Unless things have changed I'm not sure it's accurate that you only get charged for external traffic on AWS: I recall having pretty substantial charges internal to AWS just for traffic between different AZs in the same region, for example.
- api 5y ago
  Yes they all do this. I’ve speculated it’s to herd people away from running their own consensus databases and toward their managed services.
- electroly 5y ago
  I think the parent is talking specifically about S3 rather than all of AWS -- S3 is a regional service and you can access it from any AZ within that region without additional fees. Cross-AZ charges are more commonly an issue with things like load balancers and EC2 instances.
  - manquer 5y ago
    Cross Region is common use case which makes S3 access from another region or if you are migrating painfully expensive when Compute is in multiple regions . Cross Region replication is typical setup for many DR use cases and S3 will charge you Inter-region transfer cost for replication as well.
manquer 5y ago
You are only not charged if all your infra is the same location and same availability zone and same VPC .[1] The egress cost between anything beyond will cost you a ton of money [1] https://aws.amazon.com/blogs/architecture/overview-of-data-transfer-costs-for-common-architectures/ https://aws.amazon.com/blogs/architecture/overview-of-data-t...

by Macha 5y ago

tommek4077 5y ago

Virtual servers are a thing since ... forever on the Internet. At least since mid-nineties you had not to think about getting hard drives into servers, if you would not wanted to.

Macha 5y ago
VPSes were usually not cost effective either if what you wanted was a big pool of storage space. The big growth opportunity for S3 was the companies that would otherwise run their own SANs, not the startup that was going to run on a couple of VPSes or shared hosting otherwise. Even the startups that grew, they might start on a VPS provider, but outgrow them. S3 managed to scale with them and retain them as customers.
acdha 5y ago
Yes, and that's like saying that you don't understand why people eat at restaurants when there's field full of cauliflower. If you're comparing it to S3, using virtual servers means you're now taking on responsibility for configuring, operating, and securing replicated file storage in at least 3 geographically separated regions, scaling it when you start to fill up those local disks, building an API on top of that, and providing web-based access. Don't forget things like bitrot detection and prevention, storage encryption, centralized logging, event-based triggers, lifecycle management policies, tiering onto cheaper storage either by policy or automatically. For many organizations, the 24x7 staffing needed to provide an equivalent service alone would pay for their entire storage cost multiple times over. Even if your scale is sufficient to allow beating that, you are likely to have more compelling problems for that time to be spent on. (This is not saying that the egress charges are great, only that I completely understand why many, many people decided it was an acceptable tradeoff)

hinkley 5y ago

I suspect Cloudflare and any clones could set up their peering agreements with Cloud providers in such a way that they're exposed as a feature. First tier Cloud providers probably won't bite because it would open the door to people migrating out of their data centers. Second tier Cloud providers would eat that up, since it would democratize things more. Even if a competitor gets the customer, at least it's not the guy who is waging a war of attrition against you.

zerocrates 5y ago

Unless things have changed I'm not sure it's accurate that you only get charged for external traffic on AWS: I recall having pretty substantial charges internal to AWS just for traffic between different AZs in the same region, for example.

api 5y ago
Yes they all do this. I’ve speculated it’s to herd people away from running their own consensus databases and toward their managed services.
electroly 5y ago
I think the parent is talking specifically about S3 rather than all of AWS -- S3 is a regional service and you can access it from any AZ within that region without additional fees. Cross-AZ charges are more commonly an issue with things like load balancers and EC2 instances.
- manquer 5y ago
  Cross Region is common use case which makes S3 access from another region or if you are migrating painfully expensive when Compute is in multiple regions . Cross Region replication is typical setup for many DR use cases and S3 will charge you Inter-region transfer cost for replication as well.

manquer 5y ago

You are only not charged if all your infra is the same location and same availability zone and same VPC .[1] The egress cost between anything beyond will cost you a ton of money [1] https://aws.amazon.com/blogs/architecture/overview-of-data-transfer-costs-for-common-architectures/ https://aws.amazon.com/blogs/architecture/overview-of-data-t...