10 ms·
Dropbox saved $75M over two years by building its own infrastructure (2018)
- shay_ker 6y agoDoes anyone know what the break-even point is for building/managing your own infrastructure, vs. using cloud services? I'm also curious - what's the rough time/cost of moving to your own infrastructure? I'm sure it depends on lots of things, but looking for a ballpark. 1 year + 10 engineers? 5 years + 100 engineers?
- bcrosby95 6y agoPart of the problem is at smaller companies, managing your own infrastructure is just a part time job. So you have to outsource it to someone you trust, find someone in your company that wants to moonlight as a sysadmin for 10-20 minutes/day, or pay a full time employee to not do that much. How much time you have to spend is generally related to how many servers you have. In my experience, if you have automation setup correctly (1-2 weeks) you can average around 5 hours per month to manage about 30 servers.
- gravypod 6y agoDepends on what your use case is. For GPU compute, in my experience, it's pretty much 2 months of continuous usage.
- hn_throwaway_99 6y agoI mean, the more important question for me is, is running your own infrastructure something that should be a core competency. For Dropbox, the answer seems like an obvious yes. I mean, virtually their entire product is around data storage. I would be shocked if they COULDN'T save money to build a storage system tailored to their needs.
- baskire 6y agoIt’s also a lot of cold storage, low iops, moderate throughput. Not high performance compute with random high iops. Of course it’s cheaper. Compare the cost of an enterprise NAS vs external hdd from bestbuy. It’s a similar comparison here
- ebiester 6y agoThere are no shortcuts here. You really have to understand your use cases.
- cashewchoo 6y agoMy take is that there's only a very specific kind of company where on-prem vs cloud is primarily a cost-driven decision. "Cloud" providers are so much more than just the hardware. There are probably a lot of AWS customers who could absolutely save lots of money if they took all their cloud servers and magically made them physical on-prem servers. But then they might hit a situation like: "We need to create a whole new prod-sized cluster for load testing but only for a day". Do you rack all those servers, do the test, then take them off and bin them? Or what? I'm tempted to go on and on with similar examples but imo the biggest deal with cloud providers is that they can operate at such an insane infra scale that it lets you treat extremely large quantities of servers like an abstraction instead of a physical metal box that needs to be bottle-fed and rocked to sleep at night lest it get cranky. I think at fairly small scales it's easy to build in-house systems that let you treat servers like abstract units as long as you're not trying to 2+x your infra dynamically. But cloud solutions let you do that because your scale <<< the cloud providers' scale even at pretty large values of scale for any one company.
- jokethrowaway 6y agoIt depends hugely on your cost of staffing. Also, there is not only aws vs on prem. There are solutions in the middle where you don't have all of the AWS services but price is much lower. I've seen very average businesses spending 1mln per year in AWS for, really not much. IMHO most mid businesses would be better off renting servers and having some staff maintaining them.
- toast0 6y agoThere's a bunch of steps along the way between AWS[1] and managing your own infrastructure. Virtual private servers, bare metal hosting, cabinet, rack, or cage in a colo, and then operating your own datacenters. The more you buy into the AWS services and not just EC2 instances, the harder it is to move out. In other parts of the thread, people are saying you need to have a good team to run your own infra, but you also need to have a good team to run on other people's infra, and debug their bugs without visibility, so that you can guide their techs to fixing your issues, so I don't think that using other people's services absolves you of having a good team. Really the issue isn't age of company or number of engineers. It's the number of servers you need, and how stable that is. If you can't predict your server count 3 months out, you need to host with someone who has stock on hand to buffer your growth. If your server count is small, you get better geographic redundancy picking up an instance here and there from around the world from a single vendor; colo space is available everywhere, of course, but you would likely be dealing with different vendors in each locality. If you can take advantage of growing and shrinking your deployment throughout the day in response to load, and there's a dramatic difference between peak and trough, it makes a lot of sense to be somewhere that you pay by the hour, instead of by the month or have to buy for the peak and let it idle. [1] Or Google Cloud, or Azure, or Oracle Cloud or whoever.
- calderarrow 6y agoI think this quote really hits the nail on the head and confirms what a lot of people may have intuitively known about the value of cloud providers: But once certain startups turn into big companies with hundreds of millions of users, with computing needs that they’ve come to intimately understand, it can be far more efficient to set up computing infrastructure designed exactly with those needs in mind. I think the main advantage of cloud providers is to offset the risk of purchasing equipment that eventually is no longer needed, which is ideal for younger companies that are still trying to reach their market capacity or unsure about whether they'll still be around in a year. Of all the things on a startup's todo list, I can't imagine setting up their own infrastructure is the best way to improve profits or revenue. But once the constraints of a userbase are more established, it should be easier to migrate off these platforms, since their pricing is optimized for users of all business sizes and use cases, whereas your specific hardware can be optimized for your specific users. My biggest question is whether cloud providers could achieve a scale where they are able to offer the most optimal infrastructure costs for specific businesses. Maybe this is the case for smaller or mid-size companies, but I'd be interested to see where the inflection point lies.
- wrkronmiller 6y agoDropbox is in a relatively specific situation wherein their cloud costs would be extremely high (storage, bandwidth) and their in-house technical skills are probably quite good.
- kyawzazaw 6y agoCrowdStrike is building its own servers to move off from AWS as well.
- tinyhouse 6y agoSecond point is spot on. Not many companies have the engineering capabilities. Dropbox has so much potential, but their business vision wasn't great to say the least.
- wlll 6y agoThere's a lot of companies that have the scale to benefit from running their own tech, fewer who have the skills and number of people, but it's not a small niche even so.
- didip 6y agoThe thing is, Dropbox talent level is probably quite high. Thus, they can build a lot of internal APIs to manage their own hardware (Think: Software Defined Networking, Kubernetes, lambda-like platform, programatic scheduler, etc). If you don't have people who can provide cloud-like APIs to developers to self-serve, then you are trading off your developer time with money. And I'd argue that is a terrible trade off.
- ebiester 6y agoJust as a reminder: You are not Dropbox. You personally need to run the numbers with both scenarios. Depending on your use case, it may be cheaper to be in AWS, and it may be cheaper to be co-located. If you are as big as Dropbox, it may be cheaper to build your own data center. It reminds me of the arguments for and against K8s. Most of the discussion is based on use case, and not considering the solution space for all solutions. E.g. if I'm running an Erlang solution in K8s, or have a small number of servers, I may have better options. It isn't only about scale. It takes understanding your system and your needs in depth, and any short cuts lead to cost inefficiencies.
- macspoofing 6y ago>You are not Dropbox That may actually work the opposite way. The big guys can negotiate pricing with the cloud providers to the point where they may be running at close to cost. It's the small and mid tiers that get hosed with cloud pricing. >You personally need to run the numbers with both scenarios. Depending on your use case, it may be cheaper to be in AWS I'm not sure about that. Certainly cloud infrastructure provides a level of flexibility which may be advantageous if you're going through high rate of growth. Outside of that, I'm not sure you'd see any cost savings.
- deleted 6y ago[deleted]
- deleted 6y ago[deleted]
- vinay_ys 6y agoIn fact it is easier to get bigger discounts if you are a mid-size customer than if you are a big customer. If you are a very big customer, then any discount given to you will directly affect the cloud business bottomline. A public cloud inherently/structurally has more costs because it is built to be truly multi-tenant and has lots of elastic capacity. A single tenant private cloud can cut out a lot of bells and whistles and can be tailored to the needs of the company's private use-case – this brings down the cost significantly. If your compute/storage bill is greater than $10 million per year, then it is highly likely that for the same money you will get much higher compute/storage capacity in a private cloud. And that gives you more headroom for growth/elasticity etc. If your bill is greater than $30 million per year, then you will likely save significantly as well as get other strategic advantages – especially if your infra scale continues to grow over next 2-5 years.
- macspoofing 6y agoNot very surprising. Cloud infrastructure is flexible, but very expensive - certainly much more expensive than hosting your own servers.
- Aperocky 6y agoDepend on optimization - if you just want a server, yes it's much cheaper to just get one at home. But why run servers when you can just put your workloads in lambdas. That's a huge money saver, unless you're hosting video games.
- sharadov 6y agoI work for a company that does about 100M revenue per year. Run everything on prem, we did the numbers if we moved to AWS, it was almost 10 X of our current spend. Again , depends on your business, ours is complex and compute intensive. But at scale, on-prem always wins.
- jabart 6y agoDifferent numbers, but almost the exact same 10x spend difference moving all to AWS. We are data/compute heavy with low bandwidth use. We still use Lambda for bursty traffic if it works for the use case.
- chewmieser 6y agoI work for a 100M rev/year company as well and we used to run our ecommerce site on-prem as well. We knew of the increase to cost for moving our infrastructure to AWS but we're happy to bite that bullet for the vast array of services we now leverage in AWS as well as faster site response times and increased reliability. Just saying spend isn't the only factor here.
- rossmohax 6y agoI remember Gitlab blogged that they are going to use baremetal instead of Azure with some numbers showing benefit of doing so. AFAIK they quickly reversed decision and didn't even try to implement that plan, moved to GCP instead.
- mikepurvis 6y agoI'm not privy to any particulars specific to GitLab's situation, but it's possible that a little sabre-rattling caused a better deal to appear which changed the calculus on migration.
- phil21 6y agoMy limited visibility take is that their board (or someone higher up, my memory is fuzzy) told them to use the cloud, and that was that.
- mikepurvis 6y agoI could see it. As discussed elsewhere in this thread, investing in your own metal/ops is definitely a long term play, and some combination of "focus on your actual differentiators" and "why bother when one of those cloud providers will acquire us eventually and we'll just have to migrate to them at that point anyway" could be a compelling case.
- streamich 6y agoI would have loved to see them buying Wasabi instead of building their own infrastructure, and becoming the biggest client of Wasabi at the same time.
- awill 6y agono serious company wants to be 'the biggest client' of a company. You'll find all the scaling issues.
- toast0 6y agoIt depends on the company you're the client of. I worked at a top 3 client of one company, and we were also the top client of another company where I was the only engineer dealing with them. It worked out well, because they were very responsive to our issues, were able to scale, and we used the least hands on parts of their service offerings.
- simonebrunozzi 6y agoDo you know more about this? Curious if they ever entertained buying Wasabi, of if it's just an idea of yours. I think it's a good idea. But when deciding whether to acquire a company or not, there are several factors involved, only one of which is the technical fit.
- umeshunni 6y agoIt's a classic rent vs buy conversation - if you're sure about what you want, and confident that you needs will not change drastically in the short-medium term, it makes sense to buy your own infrastructure. Else, rent someone else's.
- tschellenbach 6y agoOn the other hand it's very easy to not include certain costs in this project to make it seem like a success. Did they really negotiate with AWS, Google Cloud and evaluate the project against those rates? Did they include all the costs associated with this? How about the opportunity cost of not focusing on their product. Whenever I read posts like this I always doubt how accurate they are.
- blackoil 6y agoDropbox is a unique case where majority cost is storage/bandwidth by one product/team. If you have a large organization where cost is divided in 100s of teams and products, cloud (vendor/managed) will be beneficial in removing lot of bureaucracy.
- jeffbee 6y agoNot sure how you reached that conclusion. At an org where every sub-org has their own junk in AWS a new and uniquely hideous type of bureaucracy springs into existence in order to manage/dictate which VPC is allowed to talk to which other VPC and how.
- schoolornot 6y agoIs it really because of a unique business model or the obscene markups on bandwidth and storage?
- coddle-hark 6y agoThis can be generalised to “having a deep understanding about your tech stack is good and profitable”. Spotify did the opposite and went from a complex peer to peer design to a “throw everything in an s3 bucket” design because the underlying business assumptions changed (among other things, p2p didn’t work on mobile). So yeah. I think the lesson here is stop making excuses and go compile a Linux kernel or something.
- H8crilA 6y agoSo they saved next to nothing? Their yearly operating expenses are in the order of $1.3B, which doesn't even include cost of revenue. $75M savings versus $2600M operating expenses over those 2 years comes out to about 2.8% savings.
- peteradio 6y agoWhats their margin? If they have any competition at all, 2.8% savings could be fat.
- datavirtue 6y agoGood point. How much did they increase payroll and contracting services to do this?
- technologia 6y agoIf you see it from the perspective of being able to retain staff or hiring new employees, it definitely seem worth it.
- post_break 6y agoExcept now you have to hire a staff to maintain and manage hardware, batteries, generators, buildings, security?
- us0r 6y agoOr you can just use a regular colo company and not even think about batteries, generators, buildings, security. Hell they'll even rack your gear for you.
- H8crilA 6y agoYup, exactly. What's your new R&D spend going to be going forward, now that you have to maintain an edge in so many new areas? It really is a mediocre saving for a company this big.
- bbarnett 6y ago
- igor_a 6y ago$75M over two years is compensation of 75 engineers in the SV (not even taking into account opportunity cost - this 75 folks could innovate and bring more revenue) So either it's not $75m or it was a bad idea.
- p_l 6y agoOr maybe the workload of using their own infrastructure was lower, and scales well, that the savings could go towards having 75 extra people who could innovate instead of not having them.
- ClumsyPilot 6y agoSome businesses are not about innovation, some businesses are about margins. Personal cloud storage is that business - people shop around and buy on cost. I use OneDrive because it's free with Ms Office, which I need anyway, and their 'family plan' pricing is great. I decide cloud storage for like 5 accounts, backups of family photos, etc. That is in spite of the fact that dropbox is miles better, and has extra features - they dont move the needle.
- rossmohax 6y agoValue of cloud is in many unique, quite well integrated addons like Cognito or Firebase. Once company have enough talent to build their own solutions, cloud turns into just set of VMs and storage, which is cheaper to build yourself.
- johnklos 6y ago"Cloud" handles the problem of people who buy based on who takes them out to lunch, buy based on wanting to have bragging rights, buy based on the idea that "nobody ever got fired for buying Dell / HP / whatever". Sure, you can buy and colocate a dual processor Xeon Platinum bought from Dell, but when you can get significantly more than twice the performance per dollar buying an Epyc system, it's stupid to do it. Stop comparing "cloud" to bad business decisions, and start comparing it to business decisions which would be made by people who want to get things done without ego.
- ralph84 6y agoWhat makes you think Amazon and Microsoft don't take customers out to lunch (pre-covid)?
- fakedang 6y agoLol exactly. Amazon and Microsoft always take potential customers out for lunch (or dinner). My fiancee and I have attended a number of "Azure" dinners, where Microsoft funded our expenses. The only qualm was that we had to sit through lectures where salespersons would go on about how Xamarin was the next hot shit, which bored her, a medical doctor, to death, and managed a few chuckles from me.
- jascii 6y agoI often wondered why we aren't seeing more hybrid solutions, base systems running on minimal owned hardware with cloud options for peak-load and DR. I guess part of the problem with that is the cost of maintaining different platforms, but there are ways around that.
- mxuribe 6y agoI can see that more for mid- or large-sized enterprises...If i was such an org, and already had some investment in infrastructure, then hybrid is what i would look at first. Not sure that i hear that so often though. Mostly, what i hear about is, "let's go to the cloud!". Oh well.
- dang 6y agoDiscussed at the time: https://news.ycombinator.com/item?id=16457294 https://news.ycombinator.com/item?id=16457294
- maxclark 6y agoThe lie of cloud services is ephemerality and elasticity. We convince ourselves that this hacked together solution is not actually going to run for years, or that we need instant scale 50x our current capacity. For most is that resources turn on and never turn off. This is why so much of the cost reduction conversation revolve around RI purchases. The real secret is that compute isn't the driving factor in cost - its bandwidth. I've had too many conversations where people are congratulating themselves on their $0.027/GB PPA only to explain that they are paying effectively $8.00/Mbps for a network link. The real threshold is network consumption and when you cross it figuring out a hybrid strategy is the best path.
- jariel 6y agoDropbox is competing in a narrow-margin market wherein those margins are a function of hosting costs. At the unit cost level, it's material to their business. Pfizer, where IT is a minor backoffice operation, doesn't care that 'everything is 2x the cost' because that cost is materially small, and the nimble nature of the cloud is a much bigger advantage. And they don't have the talent to make their own cloud anyhow. So to them it's cheaper. Also note that most cloud users are not startups or tech companies, they are 'basic corps' doing IT.
- dastx 6y agoOne thing that has always stuck with me after an AWS training session I attended at work is what the trainer said: "The cloud isn't necessarily cheaper, but it's usually better value for money". It's something to always remember.
- WrtCdEvrydy 6y agoThe cloud can be cheaper if you write your software for the cloud and need more redundancy. The issue is that people use the cloud as just another random VM to run their software.
- holoduke 6y agoWe are a startup. We decided to host our full stack in self managed vpses running debian. We started at one provider, but because we have everything (except the hardware) under our own super vision, we were able to move to another provider (hetzner) in just a few days. Moving away to another provider wouldn't be an issue. I believe the key is to not use any of the propitiatory services offered by all these big players. We currently pay around 1000 dollars a month for about 15 servers. Same thing at AWS will cost at least 1 week to figure out the pricing model and probably six phone calls with sales people trying to lock you in. Then in the end I am sure you would pay much much more.
- Aperocky 6y agoWhat are the size of the servers?
- dddw 6y agoYeah 1000 bucks pm for 15 servers... should be quite decently specced
- heipei 6y agoThe thing is that if you don't use any of the proprietary services offered by the bigger players they look at lot less appealing. AWS with just EC2 is one expensive-ass server provider with murderous rates for egress traffic.
- cogman10 6y agoReally depends on what you are trying to do. I work in a company that is currently trying to move over to AWS from on prem servers. Why? Not for AWS proprietary software. That's completely an afterthought (In fact, the first round is likely going to be those expensive ass EC2 instances). The real reason we are looking at moving to AWS is because they have data centers across the globe and we don't. So even though EC2 is expensive, it's far less expensive than trying to navigate the waters of setting up a datacenter in France, china, and India.
- clubdorothe 6y agoWondering why a company like Netflix did the opposite?
- dralley 6y agoDoesn't Netflix have cache boxes hooked directly into the ISP networks? I'm sure Netflix uses a lot of AWS, but as a percentage of their total traffic (which is absolutely enormous), it's probably not that much.
- filmgirlcw 6y agoYes. And although much of what Netflix does is in-house, it’s done the math and realized that for some of its workloads, AWS is just better. Especially when looking at all of the areas where Netflix is available and needs datacenters and in some of the specific compute options Netflix needs. It’s not serving traffic through AWS. It’s using AWS for storage and compute.
- p_l 6y agoIt also certainly doesn't pay by the public price book.
- llarsson 6y agoCloud is taking a taxi everywhere, bare metal is owning your own car. In one case, you pay a premium so that somebody else worries about all details and maintenance, and in the other, you take on that burden but don't pay the premium. This has always been true for everything where a service is provided to you. Great if your needs are small or not well known because there is no initial investment, but bad in the long run.
- benhoyt 6y agoNot a bad analogy, but the taxi also comes with a driver, which makes it expensive but allows you to get work done in the back while you're en route. It'd be like a cloud provider that came with a devops person dedicated to you.
- dilyevsky 6y agoExcept when driver decides to take couple days off and you can’t get anywhere or their cars breaks down for a day and they say it’s still within slo because the radio still worked (looking at you GCP)
- ehsankia 6y agoExcept in this analogy, a taxi breaking can be quickly replaced with another taxi, the issue is when the whole taxi network goes down which is more rare. If you had your own car, if the machine went down, it would be a lot more work to fix it yourself.
- dilyevsky 6y agoTrue but i can buy more cars/parts and still save money. Also it’s only rare if you judge by status page
- dec0dedab0de 6y agoSure, but if you are using the taxi often enough it may be cheaper to higher a full time driver.
- rubiquity 6y agoThere's tipping point in growing software companies where the primary cost goes from Software Developers to infrastructure and when that tipping point gets hit it swings towards infrastructure costs almost exponentially. The reason is simple: computers beget more computers at a much higher rate than Software Developers beget more Software Developers. Doubly or triply so when you're in the business of storage like Dropbox is. At some point it might be interesting to calculate the size of your company in terms of how many racks you have and how many employees you have. These days a fully loaded rack costs a lot more than your typical Software Developer salary.
- walrus01 6y agoA good compromise halfway is to have your own equipment in colocation, at a facility where your IP transit upstreams are <1ms away from the edge of the AWS and Azure ASNs. You might still have an appreciable amount of stuff hosted on AWS, Azure, GCP or similar. Depending on your scale might even be able to peer with them directly if you're big enough. Or, if you are big enough to justify it you can order direct 10Gbps cross connects within a number of facilities to AWS.
- cbg0 6y ago> <1ms away from the edge of the AWS and Azure ASNs So, essentially, in the same building or across the street? May be very tricky to pull off.
- walrus01 6y agoNot really difficult, colocation is available in the same buildings as the largest IX points... Places like One Wilshire, 350 E. Cermak, NAP of the Americas, 60 Hudson, etc. It definitely has a premium price. If you can extend your horizon of view out to buildings that are in the same metro area but less than 10, 15 or 20 km of (OTDR measured) fiber from the IX point, the performance is very nearly the same, and there's a lot more options. One example would be the datacenters in Tukwila, WA and their relationship to IX points in downtown Seattle.
- ponker 6y agoShows you how you shouldn't worry about this stuff till late. They saved $75 million while losing $3 billion of market value -- capturing market share is vastly more important than operational excellence.
- cyberlurker 6y agoAnything more recent than 2018? Any examples of other companies doing this? I see in the article that it was a public filing from Dropbox. I’ll look into more recent ones when I have some time unless someone beats me to it.
- mikekoscinski 6y agoSome assumptions to analyze this switch: - Dropbox saves $50M/year in AWS costs - Dropbox spends $200K/year (salary, benefits, equipment, SaaS, etc.) for their average infrastructure engineer Following those assumptions, Dropbox must hire <250 additional engineers for this to break even. Of course, these assumptions may be wrong (please correct them if so!) and this entirely ignores the unique computing needs of Dropbox's business, which may be unique vs. anything available off the shelf.
- esoterica 6y agoI'm guessing the $200k is a considerable underestimate.
- simonebrunozzi 6y agoAgreed; probably more in the ballpark of $275k / $300k.
- tester756 6y agoI think they could hire very skilled people from poorer countries for like 60K USD / yr
- acdha 6y ago> - Dropbox spends $200K/year (salary, benefits, equipment, SaaS, etc.) for their average infrastructure engineer The usual rule of thumb is that you assume 2:1 for salary and support costs — that starts to drift at the higher end of the pay scale but I'd doubt that a company in San Francisco isn't paying a substantial amount for office space, health insurance, etc. Your general point is still correct: call it a hundred engineers to break-even and it's likely still a substantial win, and there are some interesting angles for additional cost-optimization given Dropbox's mix of high network traffic and long-tail storage.
- rconti 6y agopfft, when I interviewed at Dropbox they were on-prem. Didn't realize they had gone to the cloud and back. Protip: If your business is storage, that is your core competency. Don't pay someone else for it.
- chmod600 6y agoCloud providers are not just server farms. They are a whole stack of software and services and an ecosystem, and more is moving into the cloud every day. Can you save a few bucks on server costs? Sure. But most of the world has moved beyond caring about servers.
- amelius 6y agoOne thing to note though: Dropbox is a cloud provider.
- xbar 6y agoDid anyone think AWS was about saving money?
- sriram_sun 6y agoSo Dropbox could be the next big cloud provider?
- bluedino 6y agoLet's look at it storage wise. A 480TB Backblaze 6.0 pod costs $22,000 to build. Dropbox has 90% of their data stored on their custom systems, and they have 'multi-exabytes' of data. Let's just say they have 5 exabytes. A petabyte costs roughly $50,000 using this scenario, and 5,000 petabytes would then cost $250 million dollars alone. If they had 20 exabytes...they would have a billion dollars in storage hardware alone? This doesn't include power, networking, labor, none of that.
- jgalt212 6y agoRiddle me this: computer and storage prices keep going down, but cloud spend keeps going up. How does that work out? And more importantly, I won't go all in on the could until the big cloud vendors start running their workloads on machines they don't physically control.
- AznHisoka 6y agoThis was viewed as a mistake by some investors as it distracted them from building features/products that would differentiate them from Google/MSFT.
- RemingtonLak 6y agoWell unfortunately I'm seeing this in my microscopic way. I moved off all of my domains and hosting from GoDaddy (shrugging in disgust) to Google domain+GCE. yikes, with virtually no traffic outside of me ssh'ing, my 2 vm instances is costing me $45/mon just basically sitting idle. I gotta be doing something wrong!
- randomdude402 6y agoYou can spin up a VPS on digital ocean for $5/month
- Schwolop 6y ago[off-topic] Hey randomdude - a few months back you replied to one of my comments with some well wishes that I could get back into motorbike riding soon. Just wanted to pass on that Melbourne is now free from lockdown again, and so I am able, and have been. It's great! I hope you're doing well too!
- RemingtonLak 6y agoThanks will look into that. Don't understand why at smallest GCE instance why the cost is so high for virtually no traffic.
- AzzieElbab 6y agoyour phone has as much computing power as an average k8 cluster
- lazylizard 6y agowe only have less than 60 racks. given every 2u can fit 4 x rtx and 4u can fit nearly 1pb raw. in general its cheaper than what people can rent to us for. also. since we already exist. we run mail, ldap n a few other bits as well. i still think its all cheaper than 3rd party hosted.