9 ms·
"The charges don’t appear to be a case of cloud providers gouging their customers" I disagree on this one. The margins on egress are, well...egregious.
by tyingq 7y ago
"The charges don’t appear to be a case of cloud providers gouging their customers"
I disagree on this one. The margins on egress are, well...egregious.
- snagglegaggle 7y agoAt some point everyone realized they could charge a massive premium per bit and as long as everyone did it, customers would have to pay. So here we are.
- notaround1111 7y agoCustomers are also to blame, when comparing the costs of two services they tend to look at the cost of an instance hour, or lambda execution and often don't look at transfer costs. Even if a cloud provider had competitive transfer costs they likely wouldn't attract any new customers and would have less margin left over to subsidize the main cost customers look at, $ per instance hour. The less attention is paid to transfer costs the better for AWS/GCP/Azure. Why hasn't a spot-market for transfer been introduced? Same reason why I can't sell my unused home internet bandwidth to my neighbors, the money is in controlling the means of transportation/communication and the providers want to keep as tight a control on that as possible.
- coleca 7y agoI wouldn't blame customers when the pricing for data transfer looks like this: https://raw.githubusercontent.com/open-guides/og-aws/master/figures/aws-data-transfer-costs.png https://raw.githubusercontent.com/open-guides/og-aws/master/... (Source Open Guide to AWS - https://github.com/open-guides/og-aws https://github.com/open-guides/og-aws)
- Pfhreak 7y agoThis seems a little deliberately obtuse -- for example, showing two arrows from an EC2 instance to an EC2 instance that exits the VPC. But I generally don't find this too hard to follow? Traffic within an AZ is generally free, but there are some cases where it's not and they generally make sense to me (leaving the VPC, pushing data from your CDN back upstream, etc.) Then again, I worked for AWS for years, so maybe I'm just used to thinking this way so I'm not really surprised by it.
- snagglegaggle 7y agoThere was a time when you paid for available bandwidth. Then network operators realized they could oversell their capacity and not spend the money to upgrade their network. You still see paying for bandwidth with residential connections, though some operators (like Comcast) are trying to do away with it.
- fauigerzigerk 7y ago>But I generally don't find this too hard to follow? This is just the static picture though. What's harder to predict are the consequences of some innocuous looking code change.
- Pfhreak 7y agoSure, but surely teams have monitoring on their usage, right? With automated rollbacks or at least one click manual rollbacks?
- fauigerzigerk 7y agoSure, but rolling back work that was already done is a waste of development resources.
- Pfhreak 7y agoDisagree. It's much more wasteful to have an outage. Roll back asap, fix the issue, roll forward, do post mortem, grow as an organization. Never repeat the same mistake.
- fauigerzigerk 7y agoWe're obviously talking past each other. What I'm saying is that for a hosting architecture to make it difficult to predict the cost of any code change is a downside compared to an architecture that makes such predictions easy and intuitive. Of course you will try to mitigate any downsides and learn what you can from any mistakes. But unpredictability makes learning far more difficult than it should, which inevitably means a waste of development resources.
- snagglegaggle 7y agoI think this has more to do with collusion than consumer behavior. On average consumers are very rational, even if their rationality is hard to explain. The issue with per-bit pricing is that a fair agreement for network use would probably look like paying a fee that makes up for the amortization of the network equipment. Anything else is an artificially restricted market created in an attempt to extract more value out of consumers by having them bid against each other. At some point, yes, we will run out of places to put the switches and routers and then the cost of connectivity will be closer to the cost of land use and will mimic rent, but we are a ways away from that.
- gwright 7y agoWhy do you think that bandwidth costs should only cover the hardware? What about the electricity, rent, payroll, sales, marketing, administrative staff, insurance, accountants, lawyers, etc.
- snagglegaggle 7y agoWell, by hardware I meant its maintenance as well. Doing so still leads you initially to the sale of bandwidth, not a bidding system.
- YawningAngel 7y agoI don't think this is true. At $JOB the extent of our cloud cost management is me reading a breakdown by SKU and looking for obvious inefficiencies, and we are very aware of transit fees. I would imagine that anyone in the 5MM+ range has actual models that account for this stuff.
- nickles 7y ago> Why hasn't a spot-market for transfer been introduced? Enron tried to create a market for this. [0] https://www.wired.com/2001/11/enron-a-bandwidth-bloodbath/ https://www.wired.com/2001/11/enron-a-bandwidth-bloodbath/
- api 7y agoThe point is to make it easy to move data in and hard to move it out.
- jrs235 7y agoJust like a roach motel!
- reallydontask 7y agoor Hotel California ...
- GhettoMaestro 7y agoYup. It is like a gravity well. Escape velocity is your egress data charges ;)
- vitro 7y agoDoctor Who: World Enough and Time
- PopeDotNinja 7y agoSomeone should set up a big fat pipe right outside of Amazon data centers with free unlimited transfers, get data on behalf of customers copied to hard drives from AWS, and then attach those hard drives to the Uber pipe. I bet that service could work for a short & glorious moment in time.
- partiallypro 7y agoIf I'm not mistaken AWS has the highest egress rates of the major cloud providers.
- deleted 7y ago[deleted]
- tyingq 7y agoAll of them (AWS, GCP, Azure) are priced outrageously compared to high quality, well peered, bandwidth.
- q3k 7y agoGCP is pretty good though. Cold-potato, very fat backbone, and very good presence at a ton of PoPs. When using GCP you basically have the same global, high-bandwidth direct connectivity presence that Google uses for its products, and that is very difficult to match by traditional T1 ISPs.
- heleninboodler 7y agoOk, help me out: "cold-potato"? :D
- techsupporter 7y agoIt is the inverse of “hot potato” routing where the network tries to get rid of a packet as soon as possible (that is, drop a hot potato). Cold potato means the network keeps the packet on-network as long as it can.
- lokar 7y agoVs "hot potato" Hold onto the packet for as long as you can vs hand it off to your peer as quickly as possible. Most networks do "hot", Google does "cold" since their network is almost always better than that of the peer.
- 7y ago
- jorprp93j 7y agoNot hard to see it as a twisted incentive to stay. The one time hit of moving could be too much to cram into tight budgets. Even though it’s costlier in the long run, I have encountered a lot of management types that shy away from having a big spike pop up on their monthly spend. Politics win over math every time. Gotta keep the boss mans feels normalized.