6 ms·
This article seems short sighted. 1. Using the AWS cost calculator is pointless, naturally an entity the size of NASA would get heavily discounted rates. 2. As
by anthonylukach 7y ago
This article seems short sighted.
1. Using the AWS cost calculator is pointless, naturally an entity the size of NASA would get heavily discounted rates.
2. As data volume grows, the complexities of working with that data expands. NASA appears to be embracing cloud computing by embracing a paradigm where scientists push computation to where the data rests rather than downloading data [1], [2], [3], thereby paying egress on only the higher order data products.
3. The report notes that NASA has tooling to rate limit and throttle access to data. This, in itself, proves that NASA didn't "[forget] about eye-watering cloudy egress costs before lift-off".
People may scream about vendor lock in, which is a fair complaint; but acting like NASA just didn't think about egress is misleading.
NASA is ultimately a science institution, I think diverting effort away from infrastructure management and towards studying data is likely a wise decision.
[1: https://www.hec.nasa.gov/news/features/2018/cloud_computing_services.html https://www.hec.nasa.gov/news/features/2018/cloud_computing_...]
[2: https://link.springer.com/article/10.1007/s10712-019-09541-z https://link.springer.com/article/10.1007/s10712-019-09541-z]
[3: https://ui.adsabs.harvard.edu/abs/2017AGUFMIN21F..02P/abstract https://ui.adsabs.harvard.edu/abs/2017AGUFMIN21F..02P/abstra...]
- deleted 7y ago[deleted]
- tda 7y agoProbably there is even good competition between the cloud providers, because hosting the data means that you can sell a lot of compute time to all the users of the data. NASA choosing for AWS means that any IO intensive analysis on that data will run faster/better/cheaper on AWS.
- kempbellt 7y ago>NASA is ultimately a science institution, I think diverting effort away from infrastructure management and towards studying data is likely a wise decision. Indeed. I am glad to see them leveraging the power of an already proven infrastructure provider rather than spending X billions of dollars trying to build and maintain their own.
- sgt 7y agoNo, that is just ridiculous. NASA is more than capable of running their own server infrastructure. They've got expertise, they've got DC's and they don't need 99.999% uptime for most of their services. Cloud providers can turn out to be insanely expensive. I am not against cloud - mostly I would recommend it for businesses but when reaching a certain size you have to consider doing your own cloud infrastructure.
- cookiecaper 7y agoYeah. It seems like everyone is hopping aboard that bandwagon and doesn't remember a world before 2009. For $1M, you can get yourself a very beefy server farm. AWS accounts still take management and a team of people that need to maintain a whole lot of different aspects of it, so you're not really saving on headcount. You're just moving that capex to opex. It's important to be flexible enough to be able to deploy onto a cloud provider if the situation demands (e.g., new client demands infrastructure run in $FOREIGN_REGION_X where you don't already have a DC), but everyone's insistence on going 1000% AWS is absurd and IMO totally unjustifiable.
- unpopdancetrio 7y agoI agree with you.... but no one wants the responsibility of securing the servers and keeping the hardware up to date. I assume NASA has an abundance of outdated hardware and no one to sell these outdated systems to. My fear is we will lose this ability to create our own servers in the future. My degree program had nothing dealing with cloud, I would tell the professors that IBM blumix and M$oft Azure was the future. My outlook toward the future was close, who knew the book store would be the biggest cloud provider. Nearly every company I worked for had a big initiative to go to the cloud. One infrastructure guy told me the final decision came when they realized they had no way to train the next generation, cloud upfront cost is less risky, and its nice to have someone else to point fingers toward when things do not work as expected.
- matchagaucho 7y agoYeah, this looks like a FUD hit job, possibly by entities made obsolete by a move to AWS. There are just too many solutions to egress optimization to mention (CDN edge caching, rate limit, throttling, tiered discounts, multi-year agreements). No gov procurement deal at this scale gets sticker shock from retail prices.
- 9nGQluzmnq3M 7y agoIt's the Register, their trademark is equal-opportunity snark about everything and everybody.
- marrickvillain 7y agoTotally and utterly not a FUD hit job. Just a reporter finding a document that told a story. I am that reporter. And FWIW when people push a dirty story that's clearly in their interests to have in print, I either don't write it because I won't be their cats-paw, or I mention it in the story. This was in plain sight, but I guess hadn't been read by anyone who understands cloud.
- NotSammyHagar 7y agoThanks for the story by the way. I thought it was great.
- Supermancho 7y ago> NASA would get heavily discounted rates Having spent a lot of money with AWS, that's giving Amazon more credit than I think is warranted.
- deleted 7y ago[deleted]
- ganstyles 7y ago+1 to this. I've been on teams that spent $75k/mo and didn't get any hint of a discount. Though we got our own on call rep to handle issues.
- soared 7y ago$75k/mo is tiny in the enterprise world. At Oracle they’d give a 22 year old fresh out of school ~30 accounts that size, for reference. I worked on a team of 9ish on a ~$5MM/mo account. (Not cloud, but a comparable business unit)
- bosswipe 7y agoAt which level do you start having real negotiation power?
- pathseeker 7y ago>NASA is ultimately a science institution, I think diverting effort away from infrastructure management and towards studying data is likely a wise decision. True, but once you're a certain scale, outsourcing everything just because it's not your competency isn't a good excuse. You can afford to hire enough people for it to become your competency.
- punnerud 7y agoThe Norwegian map authority (Kartverket) found it way to expensive to use cloud for it’s 12PB. How would it be more viable for NASA? https://translate.googleusercontent.com/translate_c?depth=1&nv=1&rurl=translate.google.no&sl=auto&sp=nmt4&tl=en&u=https://www.digi.no/artikler/innsikt-a-lagre-dataene-i-den-offentlige-skyen-er-ikke-noe-alternativ-for-kartverket/486412%3Fkey%3Dyxiq0IOF&usg=ALkJrhjUeO8q6ywU7LYgwqp0blfjk6lFqQ&key=yxiq0IOF https://translate.googleusercontent.com/translate_c?depth=1&...
- btilly 7y agoUsing the AWS cost calculator is pointless, naturally an entity the size of NASA would get heavily discounted rates. I strongly doubt this. Amazon seems to work heavily on the principle that they charge their cost + a small margin. Which means that they can't heavily discount without going below their actual costs.
- payamb 7y agoThe organisation I’m working for gets a nice %25 discount on quite a lot of AWS products
- justinclift 7y ago> + a small margin If by "small margin" you mean "several hundred percent", then sure.
- solarkraft 7y ago> Amazon seems to work heavily on the principle that they charge their cost + a small margin In their retail business. They finance that operation through the relatively high margin AWS.