19 ms·
Ultimately companies that abdicate their informatics operations like this will give their profits to their data-center operators, who will be empowered to charg
by kragen 4y ago
Ultimately companies that abdicate their informatics operations like this will give their profits to their data-center operators, who will be empowered to charge them whatever price they want. Because what's their BATNA? Migrating from Azure to AWS when Microsoft doesn't want to let them?
Renting your information infrastructure is a great way to reduce startup costs, but down the road, that information infrastructure runs your company. Trying to outsource it is like trying to outsource upper management.
To be clear, I'm not saying that the optimal amount of cloud services for an established company like FedEx to buy is 0. They bring in management consultants, too. But it sure isn't 100%.
- cs702 4y agoWithout a doubt, a future generation of executives will revisit and reverse the decision to rent all information infrastructure, but that will likely be many, many years down the road. In the meantime, the current generation of executives who made this decision will look very smart for saving the company lots of money for a good number of years. And they stand to benefit personally from it. They're doing the rational thing!
- noobermin 4y agoIt's amazing there are no other voices in the room pushing back against this. It really makes you wonder how companies even function at all, much less make money. Being so short sided never ends well.
- jsiepkes 4y agoConvincing people future risks outweigh the short term gains is very hard. That goes for all things.
- numbsafari 4y agoThere are very likely voices, but they didn’t win this battle.
- cs702 4y agoActually, I don't think the decision is that shortsighted in this case. It could work out pretty well for a decade or longer. IMHO FedEx is likely to have a good run before the costs and risks of this decision start outweighing its benefits.
- masswerk 4y agoHowever, when the situation starts to become unbearable, how long will it take to rebuild the infrastructure and source talent? Another decade? Adding the startup costs for any possible rebuild, you're apt for a substantial net loss. So you're probably going to shy away from such a reintegration, while losses accumulate further, until this becomes unsustainable, putting the entire corporation at risk. (The wise thing to do to mitigate financial impact may actually be starting the reintegration process right now.)
- beckingz 4y ago$400m saved today in exchange for $500m 10 years from now sounds like a good deal financially! Sometimes tech debt can be used instead of financial debt!
- masswerk 4y agoMind that if you'd ever wanted to integrate again, this means buying land, planning infrastructure, building it, planning, obtaining and setting up hardware and software, hiring, training, defining and testing procedures, etc, as you're starting from zero again – and all this while the costs, which forced you to consider this move, are piling up. Odds are, you'll never do this and cloud providers will know this. The comparative costs are now not those of running your own infrastructure, but those of setting it up (again).
- scottyah 4y agoFedEx had very few on site people managing the hardware, it seemed like most work on hardware was done by the suppliers. There were also very few servers there and actually running, I think the software powering the enterprise took up a lot less than they expected. Either way, I think you're spot on with the "training" part. FedEx was one of the first companies to raise significant capital and pursue a business dependent on technology. It also treated its people very well so relatively few left since the 70's. I think they just didn't train the next generation enough and they realized that those skills are disappearing rapidly because no college grads want to learn old & boring stuff and everyone who does know it costs a lot to keep (FedEx still heavily relied on COBOL when I left ~5yrs ago).
- oblio 4y agoThe optimize for the near term and after a while some other company optimizing for their near terms as startups stumble upon an awesome new product-market fit and upend the previous companies. There is no grand plan, there's just evolution.
- lupire 4y ago
- ithkuil 4y agoTragedy of the executives
- tunap 4y agoSounds a lot like farming out NOC-Ops to Wipro. Somebody had to think it was a good idea & managed to sell it to the policy makers for a nice promotion. So, when reality hits, does the same person get demoted further down than their original ladder rung?
- goldenkey 4y agoThey are gone by that point, with a padded resume to boot :-)
- kragen 4y agoI don't think it will be a future generation of executives; I think it's the current generation of executives at companies and agencies like Google, Amazon, Microsoft, and the NSA who will not rent all their information infrastructure. I agree that the executives who thus turn their companies into sharecroppers on land owned by Microsoft et al. will be richly rewarded despite the misfortune that befalls their stockholders; like Stephen Elop, if things go badly, they have an impeccable excuse.
- cs702 4y agoThanks. I think it will have to be a future generation of executives whose egos won't be tied up in old debates and who therefore will be more willing to sacrifice old decisions. If things go badly, that future generation of executives will take over sooner.
- goindeep 4y agoI used to work with a very smart man that I'm sure was some kind of secret genius. He's was that sort of tech gofer. Hardware, software, didn't matter, if there was a problem he'd solve it. Sort of guy you'd see carrying a thick ass SQL book around because he 'needed to learn it' to solve just one little problem. He built whole entire solutions for the company I worked at in his spare time that the company once tried to sell for 500k and at a previous company I heard he figured out a way for the pain mixing machines to save on paint or recycle it or something saving them 1.3 Mil a year. When Raspberry Pis first came out he was one of the first people I saw tinkering with them and he was in his 50's doing it just for fun, I think he ended up using it to open and close his garage door from work or something just to scare his wife. That sort of guy. Well he once told me something about executives and upper managers working for corporations that I have never forgotten. He said to me, and of course I am paraphrasing: "Change gives the illusion of progress". I asked him what he meant and he responded with something to the effect of "They have the habit of changing big things every 5-10 years on purpose to make it look like they are productive, and to justify their own roles, one guy will come in and 'cut costs', the new guy after him will 'invest'".
- oblio 4y agoNever confuse movement for action :-)
- hef19898 4y agoAs everybody who saw people, and orgs, rotating in place at incredible speeds can confirm.
- prometheus76 4y agoThis isn't always easy to determine, especially if you are part of the movement. Often, we move by dead reckoning and only after some amount of time can we determine if what we did was "movement" or "progress".
- smitty1e 4y agoIn this sense, Oscar Wilde was the executive's executive: "I have spent most of the day putting in a comma and the rest of the day taking it out."
- VBprogrammer 4y agoI think you are absolutely right, however when they do reverse the decision they will publish a great article about how bringing their datacentres in-house is going to save them $800m a year and a bunch of execs will grant themselves a bigger bonus for saving the company so much money. It's a win-win!
- prirun 4y agoIt's quite possible that at today's prices, they will save $400M/yr, and in the future, as cloud vendors raise prices, bringing it in-house will save them $800M/yr.
- VBprogrammer 4y agoNot only that, it's possible that cloud vendors don't charge an extra penny but that the their software grows to consume the virtually limitless computing resources available to them costing them significantly more than expected. It wouldn't take the most creative exec in the world to make a plausible looking case for changing in either direction even based on the same numbers. A bit of wishful thinking about which costs are included or excluded is probably more than enough.
- pid-1 4y agoThat seems to be a common take on HN - cloud is too expensive. I'm curious whether the folks claiming that have any data center ops experience. Because, personally, I'd rather retire than deal with Dell, HP, Cisco, fibers, cooling issues, physical security, hardware failling... And that's just the hardware. Then you still need to pay VMWare for a decent virtualization platform, monitoring tools, etc.... Seriously, no amount of money would make me work in a DC again. I believe companies selling bare metal as a service are a happy compromise of cost and convenience, though.
- bluGill 4y agoTo a company you need to pay those costs no matter what. If the AC breaks at 3am it neds to be fixed. It doesn't matter if you have your own HVAC people on sight 24x7, your own people on call to service it, a local HVAC service to come in, or you outsource the entire operations and so you have no idea how that is handled. In the end the important part of this story is that whatever you are doing with the AC continues to work. Different operations demand different levels of service (I doubt that anyone keeps HVAC techs on staff 24x7, but if the AC is that critical it is mandatory). The only case where the CEO is up at 3am is if the CEO is the owner of the local HVAC service company, not the CEO of the building with the problem. Once you realize that to management the cost is outsourced no matter what the only question is do it with your own people and HR, or outsource it. There are pros and cons to both approaches, but for most companies it isn't their business and so the only reason to do it in house is they can't trust any company they hire.
- SnowHill9902 4y agoNot really. Time to service depends on SLA and redundancy. If you have no redundancy your time to service must be less or equal than your SLA. If you have redundancy it can be longer.
- mschuster91 4y agoThe thing is, the cost for the HVAC 24x7x365 support for a datacenter will be roughly the same for a given location... but it makes a difference if it is you paying the whole bill (=you're self-hosting in your own datacenter), you are splitting the bill with a bunch of other customers indirectly (=you're self-hosting in a colo DC), or if you're splitting the bill with a shitload of other customers (=you're using some service on one of the big public cloud providers). The downside for saving the costs is that you're losing control with every step taken away: as soon as you go into a datacenter of any kind, you simply cannot call up a HVAC company and offer them 100k in hard cash if they're showing up in the next 60 minutes and fix the issue. With a colo DC you can usually go and show up there to see if the HVAC, UPS and other systems are appropriate to your needs, but with one of the big cloud providers you have to trust their word that they are doing stuff correctly.
- jes 4y agoYou are right about this. One of the visible signs of an unrecognized (and therefore, unresolved) dilemma is oscillation between two poles. I got this from the late Eli Goldratt and the problem-solving tools he created. One of those tools is the "Evaporating Cloud," which is a way to visualize a dilemma of some kind. I'd suggest that there is an unresolved dilemma here: Should we rent or own data centers? Over a period of years or decades, you can watch these things flip-flop between two extremes. It's interesting to me that this dilemma is kind of like a specialization (in OO terminology) of a more generic dilemma, which might be something like: "In general, do we want to own or rent the things we need to run our business?" If your turn your head a bit, close your eyes a bit and squint, you can see how a dilemma like this can apply to things like "What should be our policy regarding employees vs. contractors? Should we try to hire and retain over a long period of time, or should we rent the people we need to get the job done and release them as soon as we are done with them?" The overall point is that whenever you see flip-flopping between two poles, think "Unrecognized dilemma." Sorry if this is vague.
- hinkley 4y agoOften it’s simply the principle of the excluded middle. If not for the rent seeking behavior of AWS and its cohort, the answer to ”own or rent” would be clear. The answer is “yes”. Running a data center means you have your own sheep, which means you need shepherds. Shepherds are very useful to have when you have a question about sheep, especially when those questions are about how to manage or use sheep to best effect. An approachable shepherd can save the rest of the company a lot of money on missteps and bad assumptions, but if you start getting rid of all the sheep, the shepherd will leave too. We should be using cloud providers for DR, and for regional load balancing. But the company should be maintaining at least one data center of their own, in the same time zones as most of their developers. I mostly blame Dell and IBM for this. IBM experimented with making server rooms easier to maintain 15-20 years ago and didn’t make it stick. Others ran with some of those ideas. Dell… I don’t know what Dell has done but I know nobody has been writing about it, so from a visibility standpoint they have done nothing. If/when someone makes it easier (reduced labor) to manage your own servers, the pendulum will swing back.
- projektfu 4y ago
- mbesto 4y ago> rent all information infrastructure Most of them were renting most of the infra anyway: - Co-location (physical space rented) - Managed service to keep the lights on (power, back-up generators) - Leased hardware that gets replaced every 3 years - Managed service for switch, firewall, etc. monitoring - ISP, back-up generators, etc. > but that will likely be many, many years down the road They're going to explain to their future bosses that buying land, building a huge building, buying servers, figuring out cooling, setting up redundant ISPs, etc. etc. is somehow going to be smarter? Explain that one to me?
- ocdtrekkie 4y agoYou're paying for all of that whether it's the cloud or on-prem. The only real difference if you're a large company is whether you're paying another company's profit margin as well. If you are big enough to have your own datacenter, you are paying Amazon enough to buy that much physical space, power, bandwidth, IT staff, etc. plus funding Bezos' trips to space. There's a justifiable niche where you're too small to justify running your own server/below the need of one full-time IT staff where the cloud makes sense, and startups temporarily benefit from the ability to rapidly scale on cloud platforms. But any Fortune 500 transitioning to the cloud is literally just taking their money and burning it, because the alleged cost savings of efficiencies of scale are being completely absorbed by the cloud provider's profit margins. And they're still going to end up paying their own IT staff to handle the cloud management in addition to (by proxy) paying the cloud provider's IT staff to manage the hardware.
- nathanielarmer 4y agoToday I learned that economies of scale and specialization are not things.
- noobermin 4y agoPlease whenever you envoke any model, have a sense of scale or region of applicability of the model, no model is true in all cases unless you're religious. The point the GP is making is at the scale of a F500 it starts to make less sense especially if you already have the infrastructure, the expertise, the experience, and so on. AWS is going to manage your VM better than you at your 3 person start up, but the economy of scale / specialization arguments work less well when you have an experienced workforce and developed system in place already and you're one of the world's largest logistics companies.
- synergy20 4y agoSome might return to on-premise data center, but most will not. It's really just like the utilities these days, 98% people will not dig their own well and install some sewage system and buy a generator, but big companies can still opt to have them on-premise installed, even though some of those are just backup systems. there is no return for the cloud for 98% of us.
- fires10 4y agoYou generally can not go from city water/sewage to on-prem for legal reasons. However, many are going on-prem with solar. I am going almost completely off-grid for cost and SLA requirements.
- dehrmann 4y agoWhat's interesting is people seem really excited about installing rooftop solar, but I see fewer companies building collectors in places with cheap land and ample sun. That tells me part of the selling point of rooftop solar is it feels good, and the economics might not actually work.
- lupire 4y agoCaptured Solar (electricity in general) doesn't travel well over long distances. Generating solar for local use saves the cost of transport.
- dehrmann 4y ago> electricity in general doesn't travel well over long distances. High-voltage line losses can be as low as 3% per 1,000 km. That should be easily offset by the better location and better angle/tracking.
- marcosdumay 4y ago> but I see fewer companies building collectors in places with cheap land and ample sun You mean there are fewer companies making large investments than smaller ones?
- WFHRenaissance 4y agoGreat concrete example of the principal-agent problem here.
- gravypod 4y ago> that will likely be many, many years down the road And this is where people in my age range (20-30) will get to swoop in if we invest the next 10-20 years learning about and tinkering with server hardware. I highly recommend it for everyone.
- jollybean 4y agoThey are doing the rational thing and there is no going back. HNers need to get their heads around this: the economies of the could represent a fundamental, secular shift. Imagine if Fedex designed and made their own delivery vehicles. Then they 'outsourced' that to Ford/GM. You might say 'look at Ford's amazing margins, look at the money being left on the table' - but in reality, it's still more cost effective to 'buy vehicles' the to 'DIY' them. In the 'long run' those Azure/AWS margins will erode - and/or - the long tail will creep up on them. Basically data centers offering less, for less, and companies realizing they don't need the complexity of AWS do do basic things. What that will look like is hard to say. With hardware it meant 'pivot to Asia'. Will this happen again? Chinese companies creating large data centres in the US with minimal staffing, monitored and operated out of China? If we were not in a giant geostrategic kerfluffle with them, then yes, I would say that is the future. But given security issues etc. it's probably not. Can India do that? Maybe.
- kragen 4y agoFord and GM and Freightliner are not in a position to use price discrimination to confiscate FedEx's entire profits; if they try to sell trucks to FedEx at an inflated price, FedEx can just buy the same trucks from dealers, or buy them used, or buy GM trucks instead of Freightliner trucks. By contrast, generally speaking, cloud providers are in an excellent position to use price discrimination to extract the entire surplus value of every transaction. And the flexibility and reliability provided by FedEx will to a significant extent simply be that of their computers. (As chrisseaton pointed out, Boeing is in a cloudier position.)
- jollybean 4y agoSo 100% yes, AWS has much more power in the value chain than Ford. But not really. Especially to the extent that special services are not leveraged, then there are cheaper alternatives. A lot of IT is just 'instances' not 'fancy cloud queues'. AWS pricing is very transparent and people can make the decisions they want. Generally speaking, AWS does not price discriminate on the basis of 'business model' and their margins are meaningless with respect to the overall business efforts of a Big Co. I mean - unless you are doing big AI crunching, or 'free hosting content' - then frankly the AWS bill is not going to be a huge line item relative to overall operating costs.
- adamc 4y agoThis is one of the things bad about Wall Street: Short-term decision-making. Everybody cares what happens to stock prices in the near-term, rather than 10 years out.
- dehrmann 4y agoI disagree. This isn't FedEx's core competency or a differentiator for them. They're also not at a scale where it could make sense to colocate or build their own DCs. Fiddling with low-level tech infra would just be a distraction. Now, they might find that software is a differentiator for them, but that's different.
- dx034 4y agoFor a logistics company, the IT system is the differentiator. Reliably routing and tracking packages to maximize utilization of trucks and planes allows them to be cheaper and faster. That all depends on both hardware and software. So I'd definitely think that running their own systems should be a given.
- deleted 4y ago[deleted]
- systemvoltage 4y agoSome are starting to question the almighty Cloud™: https://www.economist.com/business/2021/07/03/do-the-costs-of-the-cloud-outweigh-the-benefits https://www.economist.com/business/2021/07/03/do-the-costs-o... One of the things that bother me about AWS is that I still need to manage their risk of a data center going down by using multiple availability zones and managing the complexity of extra resilience. There is a conflict of interest: AWS has a perverse incentive in keeping a single AZ robust and unless there is a natural calamity, it should not go down. I thought one of the major reasons of going to cloud is that you need not manage risk and offloading it from on-prem.
- bhewes 4y agoAt least in Oil and Gas. Servers moved back into the personal towers for the first time in a decade. Latency issues.
- walrus01 4y agoreminds me a bit of: https://www.reddit.com/r/AskHistorians/comments/vqr30e/jack_welch_extracted_record_profits_from_ge_for/ https://www.reddit.com/r/AskHistorians/comments/vqr30e/jack_... "Jack Welch extracted record profits from GE for 20 years, but left it a hollowed-out "pile of shit," according to his successor. What exactly did Welch do that was so damaging, and how did he get away with it for so long?" from the post reply, in case it's not available from the URL: alecsliu · 2 days ago · edited 2 days ago Gold2Eureka!Bravo!Today I Learned Welch took over a GE that was at the time, a major company. At the time, he viewed GE as bloated and needing to change. While he might've been right about that, the approach he took was perhaps less ideal. One of the worst things he helped make commonplace among American companies is the concept of stack ranking. The way it worked was like this: people were divided into three groups: A, B and C. A's were the top performers who needed to be rewarded generously, B were adequate performers who should be allowed to stay, and then C were those who needed to be fired. So far so good right? Well, not exactly. For Welch, these three buckets could be separated into the top 20%, the middle 70%, and the bottom 10% (20/70/10). Based on the above points, the bottom 10% would thus need to be fired annually. In the short term, this helped in making the company lean and look more productive, increasing the bottom-line and portraying an image of success. However, the long term consequences of such a change was cultural degradation and the introduction of new bloat and waste (running all of those performance reviews and firing and rehiring so many people takes a lot of money.) Consider the case of a perfectly adequate team: the entire team has achieved their targets and has contributed to the company as per their job description. The issue? In stack ranking, 10% of this team would still have to be fired even though everyone did their job. Unsurprisingly, the introduction of this competitive atmosphere where it isn't enough to succeed, one must be better than their peers, results in backstabbing, competition, and a host of issues which eventually weaken a company's competitive edge. This was only a part of Welch's general treatment of workers as numbers rather than humans. Aggressive cost-cutting, offshoring, etc. were the norm under Welch's regime and he would destroy entire divisions. This again, was great in the short-term but bad in the long term. Welch clearly had a dim view of company culture and believed it to be unimportant. The other major issue of Welch's was the acquisition of hundreds and hundreds of businesses, as part of Welch's goal of acquiring his way to the top. On the surface, this is what Welch did; on paper, he didn't destroy the main profit makers of GE so much as create new ones, primarily in the form of its financial arm. The result was that this allowed GE to play with the numbers in a way that allowed him to make sure that GE was always meeting targets set by Wall Street; in order to generate the right earnings, simply buy or sell certain assets, write-off others, etc. and when your company is an acquisition machine, it's not too hard to find the right numbers. This process helped expand GE into a mega-conglomerate but again, ultimately left the company in a weaker than expected state. In particular, on paper the core business of GE became its financial arm, as that was where all the funny business with the numbers was happening (nothing explicitly illegal though). Ignoring the damage the Welch did to GE's profit centers through his horrible business practices, this was a huge part of why GE declined so rapidly in the years following. GE's valuation was based on an inaccurate picture of its profits and value, so when the truth started coming out (especially with the Great Recession collapsing financial services profits), GE was quick to follow. As for why Welch was able to get away with it all? Well, the answer was because he was delivering. He hit the earnings targets, he made the board and shareholders very happy, by all accounts GE was the paragon of success and everything was going right. What Welch did was unprecedented, and it's hard to really understate that. For all of his faults, he had America tricked into believing that what he could do was unique and that he could avoid the realities of the economy and cyclical markets, that no matter what was going on, GE was special. Welch died a rich, rich man and many, many people profited greatly off of GE during its 20 year bull-run. Edit: My off-the-cuff writing is always horrible wrt to grammar and structure so I'll probably edit it later haha
- Jistern 4y ago
- dhzhzjsbevs 4y agoWe have our own datacentres. Lucky enough to have got them up and running pre cloud era. If we were any later we would be full cloud but the reality is we outcompete everyone on price in our space because of it.
- pauljurczak 4y agoAnd they will gently depart under their beautiful golden parachutes. What a racket.
- chrisseaton 4y agoYou can say the same thing for hundreds of parts of a company like FedEx. For example FedEx flies Boeing jets. It's completely reliant on Boeing for parts for those jets. Presumably Boeing can charge whatever it wants. Your company is always going to be reliant on other suppliers and contracts. Unless you're planning on building your own independent country in some location that has all the natural resources you need. Non-argument.
- tpetry 4y ago> For example FedEx flies Boeing jets. It's completely reliant on Boeing for parts for those jets. Presumably Boeing can charge whatever it wants. Nobody said that FedEx should build their own server hardware. And that's what you are comparing it too. FedEx could just buy server appliances from e.g. Dell (buying the Boeing jet) and operating it. Because paying some other air cargo company will eat a lot of their margin, the same with Cloud infrastructure. They are not a startup which could better invest their time in development, they can without any problems hire some people to administer their server fleet. When they switch to a cloud they will likewise hire some engineers only managing e.g. AWS to administer it.
- kragen 4y agoBoeing jets are a lot more like IBM mainframes than they are like Dell servers, which are still mostly commodity.
- int0x2e 4y agoI'm simplifying here, but it feels to me like you are making the assumption that FedEx is a mostly static business, whose IT needs should be all about minimizing the cost per IO or compute operation. In the real world, business needs are rarely static, and moving fast and innovating is extremely valuable, even for a company as large as FedEx. They are choosing to move resources from managing their IT infra to AWS, but what they're really gaining is not a reduction in labor costs or CAPEX, but rather the ability to move faster. Sure - given some headcount and sufficient CAPEX, a good engineering+SRE team can create and maintain a nice bit of infrastructure, but it is a significantly harder goal to truly deliver the benefit most leading cloud providers can provide an engineering org.
- usrusr 4y agoBut that's only really a change when you come from commodity hardware. For those still on mainframes, what's the difference? Technically the hardware might be charged per replacement cycle instead of monthly, but vendors are just as empowered to demand whatever they want. It's certainly hard to avoid lock-in running stuff on a cloud provider, but I suspect that it is even harder when depending on ye olde mainframe.
- kragen 4y agoI agree, mainframes are almost as bad.
- yarky 4y agoI agree, isn't it way easier to switch vendors when running on the cloud? I'd say that encourages competition, since we can literally move the infrastructure using keystrokes instead of muscles. This makes me think computer infra could potentially become a commodity.
- bad416f1f5a2 4y agoAs always, it depends on how you use it. Most cloud providers do let you run your own software on a managed substrate of infrastructure. But they also let you, nay, encourage you to build on top of their abstractions instead.
- usrusr 4y agoI guess you can waste a lot of effort and money on meticulously substituting "batteries included" lock-in features of your cloud provider when the easy path would in fact have been much cheaper (substitute when needed, not prematurely), just as much as you can fall victim to lock-in traps that would have been super cheap and easy to avoid. I imagine that telling one from the other is a form of art in its own right.
- Hnrobert42 4y ago> that information infrastructure runs your company This is silly. There is a lot more to FedEx than hosting physical compute infrastructure. FedEx doesn’t own all its own airports. A CSP is just another vendor.
- dsr_ 4y agoAt almost every airport that FedEx has an operation at, there is another airport within 100 miles that could be used instead, managed by a different company. The barrier to changing is not controlled by the airports. That's a competitive environment. How many major cloud providers exist, and what could they do to make it difficult for FedEx to leaving for another one?
- moralestapia 4y ago>How many major cloud providers exist Plenty! AWS is HUGE but hardly a monopoly. >what could they do to make it difficult for FedEx to leaving for another one If the guys running this at FedEx are smart, not much. There are ways to deploy all of this in a platform-agnostic way.
- twblalock 4y agoAWS, Azure, and GCP are all operating at large scale and compete with each other directly. There are other providers too. It’s definitely a competitive environment.
- tgsovlerkhgsel 4y agoTheoretically cloud providers should be able to provide both the infrastructure and managed services much cheaper (due to economies of scale) than a single company running their own. The question is how much of the savings end up in whose pockets, or whether the price at which they actually sell exceeds the TCO of running it yourself. Outsourcing at least the commodity part (dumb hardware) seems reasonable, and migrating to a competitor doesn't seem like too bad of a BANTA if you aren't locked in.
- transpute 4y agohttps://twitter.com/cynicalsecurity/status/1540742842238128129 https://twitter.com/cynicalsecurity/status/15407428422381281... > Clown Computing is an elegant, distributed, breach of trust. > Take customers, as many as you like, convince them to hand you all their data, the management of said data, the authentication and, while you are at it, the DNS. Oh, and they pay for it too! > If this was done in real life it would be called a robbery, possibly at gunpoint, definitely in broad daylight. It used to be the case that Oracle licensing was deemed the pinnacle of IT robbery ('90s) but it looks positively quaint now.
- lotsofpulp 4y agoThe transfer of various liabilities is omitted from the above tweets, which is clearly worth something to some people.
- whatever1 4y agoWhat liabilities? Cloud operators are breached on a monthly basis and there are no repercussions.
- lotsofpulp 4y agoCould be as simple as the decision maker being able to point finger at the vendor. Could be PR related, where media does not report your company’s equipment was compromised. Could be reduced exposure to getting locked out of your own system and having to pay a ransom.
- Daishiman 4y agoWhat makes you think F500 companies don't get breached all the time?
- abirch 4y agoExactly. I know if a large bank that went to the cloud after one of its infrastructure employees walked away with data on a USB stick.
- dalbasal 4y agoI think this is one side of an argument. It's valid, and it needs to be heeded, but still incomplete. Cloud setups are useful, as are many ways of their associated architecture/infrastructure elements. Saying no to these is problematic too. It is true that cloud computing has become a monopolistic, categorically non-neutral sector. They'll have you over a barrell. So, dilemmas. Difficult strategic choices.
- lr4444lr 4y agoNo, they could use several proprietary solutions that aren't "pay by the hour", that come with their own consultants as well as the physical infrastructure. Also, FedEx is not a customer that a big profit sucking outlet wants to lose by gouging rent. They have more leverage than you're giving them credit for.
- JumpCrisscross 4y ago> companies that abdicate their informatics operations like this will give their profits to their data-center operators Is the expectation data centre operators will see margin expansion? (Genuine question.) I had thought data centres were increasingly becoming commoditised.
- kragen 4y agoYes, a cloud vendor is a company that has literally all of your company's data and a plethora of cloud services that are subtly incompatible with their competitor's offerings, and their machines make the millisecond-by-millisecond decisions about what your company does. They are in a position to calculate precisely how much you can afford to pay them without going bankrupt, and charge you $1 less. Oracle has aspired to this business model for decades, but as you can see from the fact that many of the other Fortune 500 companies still have profits, hasn't been entirely successful.
- JumpCrisscross 4y ago> cloud vendor is a company that has literally all of your company's data and a plethora of cloud services that are subtly incompatible with their competitor's offerings Balancing vendor lock-in against efficiency is the remit of a half-competent CIO or equivalent. Going cloud doesn’t require using every niche AWS feature.
- kasey_junk 4y agoThe exact same thing can be said about the IBM mainframes they are replacing. Which is a much older business model.
- kragen 4y agoYes, running your business on IBM mainframes is a very expensive mistake, for the same reasons; but even IBM mainframes don't have the degree of price-discrimination power that a cloud provider does.
- etempleton 4y agoI think it depends. There is certainly a long-term cost risk, but future costs are unpredictable and it is not likely a core competency of FedEx anyway. FedEx likely will never invest enough to be great at managing their own data centers so why not remove the complication.
- lallysingh 4y agoOn mainframes, they were already giving up profits and flexibility to IBM and that small ecosystem of related vendors.
- michaelcampbell 4y ago> Trying to outsource it is like trying to outsource upper management. You say that like it's bad.
- tyingq 4y agoI do get your point, but if they have a fair amount of IBM mainframes, they are already renting their infrastructure. The mainframes have a culture of making you pay for operating system and other pieces on a basis of how much compute power you have "varied on". You don't really "own" a z-series box.
- Spooky23 4y agoMost public companies already outsource their executive management to Wall St analysts. I think the reality in this case is that the cloud providers are little different than the incumbent (ie IBM or some other dead platform). Mainframe is a sole source solution, and IBM is always trying to extract their own pound of flesh as they manage that business down to zero. At scale, you’re better off managing a handful of suppliers (probably Microsoft, Oracle, Azure, IBM) than dealing with one, and figuring out how to sustain the business as the workforce literally dies off. Nobody with half a brain is getting mainframe skills. I’m not a fan of FedEx, but they seem to be a company well aware of its limitations and able to take action to correct. For example, they went to “outsourcing” the last mile delivery to independent contractors first when they figured out (almost too late) that e-commerce needed ground shipping. They sort of did Uber, except they didn’t have the ability to just break the law.
- ArtWomb 4y agoThe "real world" counterpoint to this somewhat abstract notion is that even if FedEx wanted to build on-prem, there is not enough cloud ai talent in the universe to meet future demand. It's not just their pref for academic sanctuary, it's that there simply aren't enough cloud architects & AI PhD's with experience at AWS scale. It's hard. Choice is an illusion. GCP AutoML, Tableau, Bubble. Way simpler to train fresh grads via cloud native tooling, than from the cli (the way we did things) ;) I think the digital transformation to watch is the US Government's IRS Tax Cloud. Never been into taxation law & policy wonkery myself, but Tax Cloud is purported to Save Trillions in TCO!
- _the_inflator 4y agoEven in CS we call it "loose coupling". There is no no-coupling. I agree with you, that the hype train "cloud = total freedom" (whatever that means) is rubbish. More and more it seems, that a cloud model is just yet another option between Mainframe, AWS, Google Cloud etc.
- dylan604 4y agoAs a startup, the greatest benifit of cloud compute isn't the fact that I can scale up at the push of a button, but that I can scale DOWN at the push of a button. I want to test things on beefy systems, but I don't want to have to pay for those systems any longer than I need to use them. To me, this is the single best thing about cloud compute. Once your start up has become an established company and are so busy that you are no longer able to scale down regularly, it seems that's the time to start having your own compute vs continuing to line the pockets of the cloud providers.
- kragen 4y agoYeah, that's my thinking. Also as a small startup they don't benefit from confiscating your profits through price discrimination; if anything, they benefit from "investing" in you as a customer, to help you get to profitability, while remaining as addicted as possible to their services.
- kragen 4y agoDangling modifier here: I meant, "Also, when you are a small startup, they don't benefit from confiscating your profits through price discrimination."
- newaccount2021 4y ago
- bushbaba 4y agoAnd what do you think ibm could charge them for mainframe repairs?
- jeffbee 4y agoThat’s an incredibly silly take. Our whole economy is based on specialization. FedEx will never be as good at running datacenter as Amazon or Google. There’s room in the system for the cloud operator to earn a profit while still offering the product at a lower cost than anyone else can achieve in-house. Apple fairly notoriously hosts iCloud in other company’s clouds, and they’re a computer hardware and software company! If you’re less sophisticated than Apple, it’s a no-brainer to go with clouds.
- jotterbrain 4y agoThe part about Apple is not accurate. Apple operates several dozen datacenters, has spent north of $30 billion building them and expanding them in recent years, operates their own Kubernetes (was Mesos) cloud platform that looks a lot like Heroku internally, and leverages public cloud for a couple parts of iCloud as a redundancy play, and no more. Maps helped prompt the expansion from single-homed iTunes legacy datacenter strategy, but even that iTunes legacy has been online since the early 2000s. Note that my context ends almost a decade ago, so, there’s that. The fleet dedicated to Maps alone when I worked there was large enough to be its own FAANG/MAMAA. They’re in the datacenter game long term. In no universe does Apple “host iCloud in other company’s clouds”. Apple is notoriously a control freak and would never place their strategic services at the whim of cloud AZs. That idea was proposed and quickly eliminated. (Believe it or not, it is possible to spend that much on Azure/GCP and still only use it for basically blobs. How do you think they moved so easily in 2018ish?)
- kragen 4y agoWhile my take may be incredibly silly, jwb, it is a different take than the one you're arguing against, and in some sense diametrically opposed. My argument is not that specialization in informatics operations is unprofitable; rather, it's that specialization in informatics operations is indispensable for maintaining the negotiating position required to earn a profit. I'm not arguing that there isn't room in the system for the cloud operator to earn a profit; I'm arguing that after committing themselves completely and irrevocably to cloud operators, FedEx will no longer be allowed to earn a profit, or rather, just enough profit to keep their stock price from collapsing. Now, it may be that the advantage of specializing in informatics is so powerful that this situation is unavoidable, and the only viable option for companies like FedEx is to become, in a sense, franchises of Amazon, Microsoft, Google, or Baidu. You remember when this happened to companies like Intergraph in the 01990s: they were reduced to undifferentiated Microsoft resellers. And it's not clear they really had another option. I'm not confident that the situation is currently so extreme, but maybe it is. As other commenters have noted, you were pretty comprehensively wrong about iCloud, but that's a minor supporting point.
- mguerville 4y agoAbsolutely, companies outsourcing their data infrastructure to the big 3 will end up having "supply chain" and Intellectual Property issues with their data in the same way companies that outsourced too much of their supply chain top SE Asia / China did. But by the time this becomes a problem the executive team will have cash out nice bonuses from the short term gains from cost savings...
- amelius 4y agoYes, it sounds like they are about to head down the same road as many large firms who sold all their real estate because short-term investors said it was a good idea.
- WJW 4y agoFedex does not create their own electricity or fuel either, yet without those they have no going concern. Yet they choose to acquire those services on the open market because it is cheaper, even though they do make themselves more dependent on the supplier. In the end, full self-sufficiency is just not viable for large companies in a highly specialized economy. In this case, if a cloud provider gets too monopolistic then the BATNA for fedex is to re-hire (or train) enough sysadmins to run their own systems again. That puts an upper limit to how much a cloud provider can charge for their services, in addition the competition between Azure/AWS/GCP will also keep prices somewhat down. The cloud providers know this and will price accordingly.
- kragen 4y agoI'm not arguing for autarky, I'm arguing for maintaining a strong negotiating position to keep from being taken advantage of. Fuel is fungible, and electricity is provided by regulated monopolies who are forbidden to price-discriminate, so the same issues don't arise as when you're outsourcing your core business processes to Microsoft. I don't think FedEx re-hiring a competent sysadmin team and rebuilding data centers once they've lost that knowledge is merely a question of spending enough money on the problem; it's the kind of high-risk IT project that often sinks companies.
- renonce 4y agoThe network traffic price is absolutely vital. This is essentially the ransom that the cloud provider holds on you for leaving.
- thdxr 4y agoit was exactly this kind of thinking that lead to Japanese automakers crushing American ones vendor relationships do not have to be hostile. AWS has been around for a while and has never raised prices, some services have gotten 99% cheaper. yes there's some hypothetical day where they say "tricked you, all that stuff about margin being opportunity was a lie" and they try to extract value short term while burning their reputation but every day that goes by where this doesn't happen is $$$ wasted on trying to avoid it
- marcosdumay 4y agoHum... The US business all already converted from the GP's mindset, and the US automakers still need to be rescued from time to time. I'm betting it is not this kind of thinking exactly that causes the problem. (Oh, and do take a look at the vertical consolidation of the Japanese industry.)
- adam_arthur 4y agoIn a competitive market, margins are dictated by marginal cost of production of you and competitors. Data center/SaaS is somewhat naturally monopolistic due to cost of switching though. Legislation should target "high cost of switching" areas to make them more competitive. Translates to lower prices, better for society in the end
- MattGaiser 4y agoWas Fedex really running its own infomatics operation or did they mostly have layers upon layers of IBM consultants? Yes, the "owned" the hardware in that case, but it would likely have been no easier to switch.
- api 4y agoYes but the round trip to/from the cloud can be a forcing function in a large bureaucratic company to dump a lot of ossified infrastructure and IT organizational baggage. When you re-localize you'll be building a new IT organization to do it and using new hardware. Big organizations often do things that seem wasteful as a way of dumping organizational cruft.
- deleted 4y ago[deleted]
- knorker 4y agoYou could make the same argument for companies that don't own their own buildings, their own land, or have vendors of any shape or form. That is, all companies ever. The opposite of what you're proposing is "do your core business". Why would fedex be better at running computers than Azure is? Why does FedEx use vans built by a car company? They should build their own vans. The tires should clearly be made from rubber that FedEx vulcanized themselves. I've seen huge insurance companies outsource not just their hardware, but their ops too. McDonalds may be in the real estate business (and not the burger business), but FedEx is not.
- menzoic 4y ago>Renting your information infrastructure is a great way to reduce startup costs, but down the road, that information infrastructure runs your company. Trying to outsource it is like trying to outsource upper management. This isn't a one size fits all thing. For a company like FedEx I don't see the advantage of owning their own data centers. They just don't have the scaling challenges that would require that. Data centers or information infrastructure as you put it does't fall within the core competency of FedEx, so I don't think it's a fair comparison to say its like outsourcing upper management. I think its more fair to so that FedEx building their own datacenters is like building their own roads to deliver packages on. For a company like Facebook or Google, the difference is clear. They need to handle such a high scale of traffic and volume of data that they need custom infrastructure to be able to scale efficiently at significantly reduced costs. The same reason it made sense for them to invest in building their own databases, because the existing options didn't meet the scaling requirements. FedEx won't realistically be needing their own database or infrastructure any time soon.
- alexvoda 4y agoDifference being that FedEx pays 0 $/km for the roads, but the $/GB and $/GHz will be at the mercy of their cloud provider.
- citizenpaul 4y ago> pays 0 $/km for the roads, That is really not true at least in the USA. There are all kinds of taxes and fees for using the roads with large trucks. Have you ever seen the weigh stations on the sides of the highway in the US? Those are there to fine the trucks for what they are carrying if it is beyond what is allowed among other things. You said km though so you probably are not in the US.
- misterprime 4y agoEvery state charges their own fee per mile to commercial trucks. Filing taxes as a long distance trucking company that operates in multiple states is pretty annoying. There's also tax built in to every gallon of fuel. There are also flat annual registration fees you have to pay as well.
- jollybean 4y agoFedex is not in the business of making their own cars, they're not going to be in the business of fairly complex cloud ops either. This is permanent secular shift. The advantages of the cloud are just starting to be realized. That said, for some kinds of operations, they may want a lower cost cloud provider with a more basic stack. Secondary operators of the world need to get together and start offering a standard stack for basic things so that people can wean off of Azure and AWS.
- iso1631 4y agoThey don't run their own electric companies, and often don't even own their own buildings, both of those are essential. I suspect they lease their trucks and planes too. If they're building it on AWS only kit and locking in, then they open themselves to risk. If they build it on standard VMs running on AWS, Azure, Digital Ocean, then they can shop around at contract renewal time, just like they can with Mercedes vs Ford vs VW trucks
- dredmorbius 4y agohttps://news.ycombinator.com/item?id=31995276 https://news.ycombinator.com/item?id=31995276
- earthboundkid 4y ago> Because what's their BATNA? Migrating from Azure to AWS when Microsoft doesn't want to let them? Uh yes, exactly? Clouds give small customers the first hit free as a loss leader. With very large customers, clouds have to be price competitive because if you're at a large scale, it is totally worth spending millions of dollars for a 5 year plan to change clouds. The people who get screwed are the medium to large customers for whom the cost of changing clouds is too high to recoup in a reasonable timeframe. The moral of the story is be very small or very large, but avoid being medium sized.
- bpodgursky 4y agoAnd if all you use is object storage, k8s, and some kind of SQL data lake, migrating between clouds is... actually not that terrible? It's a huge project but there's not a lot of actual redesigning.
- 8ytecoder 4y agoEvery one of these large enterprises, including the cloud providers themselves, like stability. So they sign multi-year multi-million dollar contracts that expect a minimum spending and offers a negotiated discounted price. It’s also not just the cloud, enterprises know they get the best pricing when they commit to a vendor and the vendor also bends over backwards to accommodate these large companies. As long as there are 2-3 cloud providers big enterprises will be just fine.
- BrainVirus 4y ago>With very large customers, clouds have to be price competitive because if you're at a large scale, it is totally worth spending millions of dollars for a 5 year plan to change clouds. You've literally just explained why a large company would be perfectly willing to be overcharged by a cloud provider in order of millions of dollars. They would have to pay that for migration anyway and there is always a risk of creating disruptions in the process.
- earthboundkid 4y ago
- themerone 4y agoMy company built a data center that was supposed to lead us into the future, and it started running out of capacity within a few years. The cloud is the only reasonable way to keep up with exploding compute demands.
- abirch 4y agoExactly, they literally design their own hardware. To me it's like trying to roll your own word processor. You can but unless it's core to your business, it's cheaper to buy.
- kragen 4y agoI feel like I could probably roll my own word processor this weekend.
- rendang 4y agoThis seems to imply that if processing loads for a given line of business start to level off, it may lead some to move away from the cloud.
- njarboe 4y agoSimilar to the decision to own a building or rent. Moving is a real pain and can kill companies. Better get a long lease with lots of extension options because at the end of the lease your rent is going to go way up.
- marcosdumay 4y ago> Because what's their BATNA? Migrating from Azure to AWS when Microsoft doesn't want to let them? As long as they have backups, yep, that's a quite possible alternative. And backups cost very little, and don't need to run flawlessly 24x7. They will probably pay through their nose either way (backups or not, migrating or not), because that's how the cloud works. But well, that's for their bean-counters to count. As long as they have backups, it's not strategy defining or an existential risk. (Anyway, nobody goes around talking about BATNA of the proprietary, rented mainframes. I wonder why.)
- draw_down 4y agoProbably for the same reason nobody goes around talking about the BATNA of having employees. This doesn’t make any sense.
- marcosdumay 4y agoNot only people do talk about the BATNA of hiring people all the time, but I fail to see how this is relevant to a machine rental contract.
- ryanmarsh 4y agoempowered to charge them whatever price they want That's correct assuming monopolistic behavior. I believe pricing in information infra will be a race to the bottom. We've not seen a lack of competition in this space.
- justsomeuser 4y agoI think it's fine to be honest. Over time competition between the 3 major clouds combined with hardware getting cheaper will mean there is not going to be a massive jump in prices, if any at all. It is not impossible to design relatively cloud-portable server software. Also I think FedEx, and companies in general, would prefer to increase revenue rather than reduce costs (by running their own data center) in order to increase their net profit.
- avereveard 4y agoEh as long as one design for portability migrating isn't that hard, which enables them to leverage their own size for volume discounts As long as they stick to services that have overlap been providers (postgres, mongodb, nfs/cifs, etc) or transformers (s3, azure blob storage) and package their code in somewhat agnostic format (docker images, wars, what have you) they'll be fine.
- riku_iki 4y ago> Renting your information infrastructure is a great way to reduce startup costs they can rent hardware only, and still run their own infra (kubernets and all stuff on top on it), then they can negotiate reasonable prices and migrate away if they want to.
- wnevets 4y agoYou're forgetting the most important part of this entire thing, the massive bonuses the current executives are going to get for saving the company over $400m. Whatever happens to the company afterwards is not their problem, they're already moved on to the next company to spread the legend of them saving FedEx over $400m.
- bradly 4y agoI helped with the closure of Intuit’s data centers and it was absolutely the right move for them. The amount of resources needed to maintain data centers world wide is significant.
- astrostl 4y ago> Ultimately companies that abdicate their informatics operations like this will give their profits to their data-center operators, who will be empowered to charge them whatever price they want. This "ultimate" endgame has been predicted since at least 2006 and we've yet to see anything but price decreases on cloud services. Tons of labor has been invested into deliberate cloud agnosticism with no apparent results. I am fully on board with economic arguments that favor data centers over cloud for some organizations. I don't think the capture-and-increase argument holds evidential water or ever will in a competitive environment, and the environment is more competitive than ever.
- thethimble 4y agoTo add to your point I think the competitiveness will increase over time with further technology innovation. Cloud providers are constantly adding features and trying to catch up with each other. New entrants are adding novel competitive dynamics as well (e.g. Cloudflare or Deno Deploy). The cloud market is so large ($ TAM; also growing rapidly) I think there will always be a tailwind of investment and innovation that prevents monopolistic stagnation.
- madrox 4y agoThis line of reasoning has been around as long as the cloud has been a thing, and yet companies are still doing it and seeing better results than running their own data centers. At what point do we put this argument to bed? You want to talk about fear of switching costs? Fedex was still on mainframes, for crying out loud.
- iancmceachern 4y agoIt's like oracle
- xnx 4y agoOutsourcing hosting doesn't seem that different from outsourcing electricity. If it's not a core competency, or competitive advantage, let somebody else deal with it.
- xwdv 4y agoIt is 100%. Cloud services are about to evolve in ways that non tech-specialized companies can replicate on their own. Cybersecurity requirements will grow and bandwidths will be pushed to the limits. Just leave it to the professionals.
- eikenberry 4y agoWhy be an information infrastructure company on top of a delivery company? Why would they want to do both if they didn't need to. And pretty much all companies are going multi-vendor to avoid lockin and provide leverage for negotiations. Their information is the part that runs the company, not the stack.
- kragen 4y agoWhy be a management company on top of a delivery company? Or a finance company on top of a delivery company? Or an employer on top of a delivery company? Because if you outsource any of those functions 100%, your vendor owns the actual company.
- eikenberry 4y agoIf your company is already public (like FedEx) then you don't own your company anyways. So who cares who owns it. All that matters is that it profits the shareholders.
- kragen 4y agoYeah, the shareholders really don't appreciate it when the management of the company sells it out from under them to a vendor, cutting off the shareholders' future stream of profits. The cloud is a new enough grift that they maybe aren't aware that that's what's happening.
- stanfordkid 4y agoYeah but cloud infra is a competitive market with multiple players, it's not like they're going to just buy a monthly AWS contract. They will probably have a cloud migration strategy, multiple year fixed contract, and multi-cloud support.
- mark_l_watson 4y agoI used to agree with your opinion. Then I worked as an engineering manager at Capital One (deep learning, not infrastructure) and I saw all of the good reasons they had to move to AWS.
- kragen 4y agoThat sounds interesting! Can you elaborate?
- shaman1 4y agoDisagree, companies cannot focus on too many things at once and get them right. Better for them to focus on logistics, fleet, cargo, etc than investing in data centers. Staying in your area of competence usually yields the best results. Btw, as I was using FedEx for an international shipment, their IT services are abysmal and could use a shake-up.
- deleted 4y ago[deleted]
- novok 4y agoYes, just like leasing office buildings instead of buying them causes companies to give all of their profits to real estate companies. Or using dell windows laptops. /s If AWS et all get too greedy, competitors will pop up saying 'your margin is my opportunity' and market competition happens for something that is a commodity, and becoming more so as time goes on.
- FooHentai 4y agoI agree that long-term, outsourcing of compute capability is probably going to be a negative for everyone. That said, when your organizations point of difference isn't rooted in computing, and you're not a producer of compute platforms yourself, why wouldn't you source that from a third party? The arguments don't look that different to buying pizza boxes from HP, Sun etc - If they could have gouged your profits away I'm sure they would, but as long as the space is commodified competition should be assured, and that sets pricing down at competitive levels, not monopolistic levels. Far as I can see the only arguments here are that either cloud compute is naturally monopolistic, which seems a stretch, or there's another factor that will lead to ruin here (e.g. long-term connectivity loss between your and your compute in a particularly nasty disaster scenario). Like, I don't care* if my baker's goals are orthogonal to my own. They just provide crullers for the morning stand up and I can get them from other places despite the insurrection that would occur if staff ever went without. I can likewise not care if my cloud provider's goals are not aligned, because if they screw me I can just shop at another bakery, so speak. All of this said, outsource to cloud isn't free. You have to have an exit, or at least transition, plan. You have to architect into the configuration, not just transpose what you have. You have to maintain platform-agnostic restorable backups of the information that's critical to your organization, and have an operable proven plan to bring in online. Failure to do these things, which I think is the case for a scary number of organizations that have 'gone cloud', could indeed lead to ruin. I know this comment is weird. I'm in an odd space here of agreeing with your conclusion but mostly disagreeing with the premises on which you reached it. *until we see a cloud provider that also owns major fab i.e. if Intel or AMD went into direct cloud provision and took it seriously for about a decade I'm pretty sure it's game and over the world itself would implode from the sheer monopoly that would ensue. Until then, however...
- Jistern 4y agoYour reasoning is faulty and very probably self-serving. More and more companies can and will outsource their infrastructure. IT guys hate this because it threatens their "paychecks." The optimal amount of cloud services for an established company like FedEx is 100%, not merely with a "disaster recovery plan" but with live, 99.99% redundancy by which I mean two almost exact systems running nearly simultaneously (within a second or two of one another) on two completely different networks. FedEx enjoys almost all of its competitive advantage from its physical network. IT is not core to its business. Here's the problem... almost no company actually does disaster recovery and "parallel redundancy" properly because most C-level executives only pay lip service to it. Therefore, the whole notion that disaster recovery and "parallel redundancy" don't work is predicated on the false notion that companies actually have proper disaster recovery and "parallel redundancy" in the first place.
- kragen 4y agoIt is surely true that I have a cognitive bias in the direction you say, and that many companies operate at lower levels of informatics infrastructure reliability than Azure.
- prmoustache 4y agoI am pretty sure part of it is also some kind of greenwashing move to abstract away your carbon footprint. Like exporting pollution to far east by producing there. Sure there are tools to calculate your energy/carbon footprint from cloud workloads but if you don't operate a datacenter yourself anymore you can't be as much accountable as the cloud vendor is. But there will surely be a backlash and an - at least partial - return to operating your own datacenter for some companies in the future.