9 ms·

AWS' Sponsorship of the Rust Project

304 points by GolDDranks 7y ago

Touche 7y ago
I read this a couple of times and I can't tell how they are sponsoring the Rust Project. Apparently Rust uses some AWS services, are they now getting these for free, is that the sponsorship?
- arusahni 7y ago
  Based on the postscript: > ps – AWS credits are available for other open source projects! it sounds like it
- Mathnerd314 7y ago
  Yeah, free CI and web hosting. Those are probably the biggest costs in running the project, besides paying developers to work on it. "We’re thrilled that AWS, which the Rust project has used for years, is helping to sponsor Rust’s infrastructure. This sponsorship enables Rust to sustainably host infrastructure on AWS to ship compiler artifacts, provide crates.io crate downloads, and house automation required to glue all our processes together. These services span a myriad of AWS offerings from CloudFront to EC2 to S3. Diversifying the sponsorship of the Rust project is also critical to its long-term success, and we’re excited that AWS is directly aiding this goal." https://aws.amazon.com/blogs/opensource/aws-promotional-credits-open-source-projects/ https://aws.amazon.com/blogs/opensource/aws-promotional-cred...
  - fortran77 7y ago
    CI for Rust can be VERY expensive, given the vast amount of CPU and memory the Rust compiler needs. Good for Amazon to handle this important task.
    - ComputerGuru 7y ago
      CI is not run on EC2, MSFT is covering that on Azure.
    - minxomat 7y ago
      Running with sccache drastically reduces build times. I suspect rust is using it to accelerate builds with it's s3 backend. I'm using the Azure storage backend for my GitHub action builds. Even on simple projects (3k LOCs, dozen crates), it cuts more than 60% off the build time.
  - pietroalbini 7y ago
    By the way, we don't actually run our CI on AWS. We use S3 to store caches and build artifacts, but all the builds run on Azure Pipelines at the moment.
    - winter_blue 7y ago
      So with this announcement, I assume you’ll be switching to running your CI AWS soon (since it’d be free)?
      - ComputerGuru 7y ago
        Microsoft is providing Azure pipelines to the Rust project free of charge. Switching CI is not trivial, in all cases.
        steveklabnik 7y ago
        Additionally, we just switched to Azure pipelines after evaluating a number of options. * https://internals.rust-lang.org/t/which-ci-platform-should-rust-use/9322 https://internals.rust-lang.org/t/which-ci-platform-should-r... * https://internals.rust-lang.org/t/update-on-the-ci-investigation/10056 https://internals.rust-lang.org/t/update-on-the-ci-investiga...
      - pietroalbini 7y ago
        Microsoft is already sponsoring our CI on Azure Pipelines, so there would be no need to do that.
- Santosh83 7y ago
  This comment explains, from the horse's mouth... https://www.reddit.com/r/rust/comments/dhrkit/aws_sponsorship_of_the_rust_project/f3q0d1f/ https://www.reddit.com/r/rust/comments/dhrkit/aws_sponsorshi... PS. The comment on the reddit thread is from one of the co-authors of the blog announcing the sponsorship.
- drewm1980 7y ago
  Check out crater: https://github.com/rust-lang/crater https://github.com/rust-lang/crater The rust devs recompile a huge chunk of the entire rust ecosystem to make sure new compiler versions don't break things. I can't imagine something like this being even close to feasible in the C++ ecosystem; there is too little standardization of build tooling, too much brittle/broken code. Still it's not cheap and Amazon is paying, bless their hearts and excess compute capacity when it's not Christmas.
  - pnako 7y ago
    C++ being a standard, you don't need to rebuild the world to develop your compiler. That being said, there is nothing preventing something similar with C++. In fact, that's pretty much what Linux distributions and BSDs do when upgrading the compiler, see for example https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=240629 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=240629
    - Dylan16807 7y ago
      How it's standardized doesn't matter. And neither language 'needs' it. But it would be just as useful to C++ compiler devs as it is to Rust.
deleted 7y ago
[deleted]
InvaderFizz 7y ago
This appears to be part of a larger announcement that they are now providing AWS promotional credits to open source projects. Source: https://aws.amazon.com/blogs/opensource/aws-promotional-credits-open-source-projects/ https://aws.amazon.com/blogs/opensource/aws-promotional-cred...
- bklyn11201 7y ago
  Credits are available for one year. Sorry, this new credit program just seems like another customer acquisition cost and not a long-term commitment to supporting open-source projects.
ksec 7y ago
No love for Ruby again, the folklore of Ruby hatred within Google and Amazon is quite real.
- WaxProlix 7y ago
  Ruby is used super widely throughout Amazon; any hatred is likely well deserved.
  - chrisseaton 7y ago
    Amazon uses Ruby a lot? I've never seen them talk about anything with Ruby at all. Can you give any pointers?
    - WaxProlix 7y ago
      It's a lot of internal tooling, likely nothing interesting to you or worth talking too much about.
      - chrisseaton 7y ago
        > nothing interesting to you How do you know what's interesting to me?
        WaxProlix 7y ago
        An attempt at a polite way of saying "I'm not going to talk about it." Please take a hint instead of downvoting :)
        chrisseaton 7y ago
        Sounds more condescending and dismissive, rather than polite! And I didn't downvote you - I can't possibly have done, can I, because you can't downvote a reply to your own comment on Hacker News.
ryanmarsh 7y ago
There seems to be an uptick in open source related announcements from AWS as of late. I can’t imagine why...
- reilly3000 7y ago
  All of the AWS teams have to lock what is going into reInvent weeks before the event. I'm assuming there is some sort of cutoff happening soon, so lots of activity is happening now.
tracker1 7y ago
Hard to find a corporate sponsors list.. but from the RustConf list, looks like AWS, Google and MS/Azure are all Rust supporters. Not to mention MS looking into replacing some Windows internals with Rust. I think Rust will see huge growth from best of breed WebAssembly tools to the really small/fast libraries available. I'm not that deep, but it's been an interesting learning curve. Hoping to find a couple things to actually work on in terms of projects this coming year with it. Edit: I am curious if we'll see some Docker tooling move towards Rust, most of that is currently Go, though some of the wasm stuff might be a better direction vs. containers.
- moocowtruck 7y ago
  why would docker tooling move from go to rust? I mean rust is good and all, but go had its advantages too would there really be that much benefit?
  - tracker1 7y ago
    It really depends, rust doesn't have the runtime overhead and can do lock-less approaches to in-memory data. For example, etcd, kubernetes (service) and some other systems may reduce overhead and improve performance with a rust implementation.
    - Thaxll 7y ago
      You don't replace millions of line of code of something working with a language that looks faster on paper.
      - steveklabnik 7y ago
        This is true in general. Kubernetes was ported from Java to Go, though I have no idea how large it was when it happened... that said I agree with you, and it's more likely that a new tool would appear than any of these deciding to suddenly re-write the universe.
      - tracker1 7y ago

304 points by GolDDranks 7y ago

I read this a couple of times and I can't tell how they are sponsoring the Rust Project. Apparently Rust uses some AWS services, are they now getting these for free, is that the sponsorship?

arusahni 7y ago
Based on the postscript: > ps – AWS credits are available for other open source projects! it sounds like it
Mathnerd314 7y ago
Yeah, free CI and web hosting. Those are probably the biggest costs in running the project, besides paying developers to work on it. "We’re thrilled that AWS, which the Rust project has used for years, is helping to sponsor Rust’s infrastructure. This sponsorship enables Rust to sustainably host infrastructure on AWS to ship compiler artifacts, provide crates.io crate downloads, and house automation required to glue all our processes together. These services span a myriad of AWS offerings from CloudFront to EC2 to S3. Diversifying the sponsorship of the Rust project is also critical to its long-term success, and we’re excited that AWS is directly aiding this goal." https://aws.amazon.com/blogs/opensource/aws-promotional-credits-open-source-projects/ https://aws.amazon.com/blogs/opensource/aws-promotional-cred...
- fortran77 7y ago
  CI for Rust can be VERY expensive, given the vast amount of CPU and memory the Rust compiler needs. Good for Amazon to handle this important task.
  - ComputerGuru 7y ago
    CI is not run on EC2, MSFT is covering that on Azure.
  - minxomat 7y ago
    Running with sccache drastically reduces build times. I suspect rust is using it to accelerate builds with it's s3 backend. I'm using the Azure storage backend for my GitHub action builds. Even on simple projects (3k LOCs, dozen crates), it cuts more than 60% off the build time.
- pietroalbini 7y ago
  By the way, we don't actually run our CI on AWS. We use S3 to store caches and build artifacts, but all the builds run on Azure Pipelines at the moment.
  - winter_blue 7y ago
    So with this announcement, I assume you’ll be switching to running your CI AWS soon (since it’d be free)?
    - ComputerGuru 7y ago
      Microsoft is providing Azure pipelines to the Rust project free of charge. Switching CI is not trivial, in all cases.
      - steveklabnik 7y ago
        Additionally, we just switched to Azure pipelines after evaluating a number of options. * https://internals.rust-lang.org/t/which-ci-platform-should-rust-use/9322 https://internals.rust-lang.org/t/which-ci-platform-should-r... * https://internals.rust-lang.org/t/update-on-the-ci-investigation/10056 https://internals.rust-lang.org/t/update-on-the-ci-investiga...
    - pietroalbini 7y ago
      Microsoft is already sponsoring our CI on Azure Pipelines, so there would be no need to do that.
Santosh83 7y ago
This comment explains, from the horse's mouth... https://www.reddit.com/r/rust/comments/dhrkit/aws_sponsorship_of_the_rust_project/f3q0d1f/ https://www.reddit.com/r/rust/comments/dhrkit/aws_sponsorshi... PS. The comment on the reddit thread is from one of the co-authors of the blog announcing the sponsorship.
drewm1980 7y ago
Check out crater: https://github.com/rust-lang/crater https://github.com/rust-lang/crater The rust devs recompile a huge chunk of the entire rust ecosystem to make sure new compiler versions don't break things. I can't imagine something like this being even close to feasible in the C++ ecosystem; there is too little standardization of build tooling, too much brittle/broken code. Still it's not cheap and Amazon is paying, bless their hearts and excess compute capacity when it's not Christmas.
- pnako 7y ago
  C++ being a standard, you don't need to rebuild the world to develop your compiler. That being said, there is nothing preventing something similar with C++. In fact, that's pretty much what Linux distributions and BSDs do when upgrading the compiler, see for example https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=240629 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=240629
  - Dylan16807 7y ago
    How it's standardized doesn't matter. And neither language 'needs' it. But it would be just as useful to C++ compiler devs as it is to Rust.

deleted 7y ago

[deleted]

InvaderFizz 7y ago

This appears to be part of a larger announcement that they are now providing AWS promotional credits to open source projects. Source: https://aws.amazon.com/blogs/opensource/aws-promotional-credits-open-source-projects/ https://aws.amazon.com/blogs/opensource/aws-promotional-cred...

bklyn11201 7y ago
Credits are available for one year. Sorry, this new credit program just seems like another customer acquisition cost and not a long-term commitment to supporting open-source projects.

ksec 7y ago

No love for Ruby again, the folklore of Ruby hatred within Google and Amazon is quite real.

WaxProlix 7y ago
Ruby is used super widely throughout Amazon; any hatred is likely well deserved.
- chrisseaton 7y ago
  Amazon uses Ruby a lot? I've never seen them talk about anything with Ruby at all. Can you give any pointers?
  - WaxProlix 7y ago
    It's a lot of internal tooling, likely nothing interesting to you or worth talking too much about.
    - chrisseaton 7y ago
      > nothing interesting to you How do you know what's interesting to me?
      - WaxProlix 7y ago
        An attempt at a polite way of saying "I'm not going to talk about it." Please take a hint instead of downvoting :)
        chrisseaton 7y ago
        Sounds more condescending and dismissive, rather than polite! And I didn't downvote you - I can't possibly have done, can I, because you can't downvote a reply to your own comment on Hacker News.

ryanmarsh 7y ago

There seems to be an uptick in open source related announcements from AWS as of late. I can’t imagine why...

reilly3000 7y ago
All of the AWS teams have to lock what is going into reInvent weeks before the event. I'm assuming there is some sort of cutoff happening soon, so lots of activity is happening now.

tracker1 7y ago

Hard to find a corporate sponsors list.. but from the RustConf list, looks like AWS, Google and MS/Azure are all Rust supporters. Not to mention MS looking into replacing some Windows internals with Rust. I think Rust will see huge growth from best of breed WebAssembly tools to the really small/fast libraries available. I'm not that deep, but it's been an interesting learning curve. Hoping to find a couple things to actually work on in terms of projects this coming year with it. Edit: I am curious if we'll see some Docker tooling move towards Rust, most of that is currently Go, though some of the wasm stuff might be a better direction vs. containers.

moocowtruck 7y ago
why would docker tooling move from go to rust? I mean rust is good and all, but go had its advantages too would there really be that much benefit?
- tracker1 7y ago
  It really depends, rust doesn't have the runtime overhead and can do lock-less approaches to in-memory data. For example, etcd, kubernetes (service) and some other systems may reduce overhead and improve performance with a rust implementation.
  - Thaxll 7y ago
    You don't replace millions of line of code of something working with a language that looks faster on paper.
    - steveklabnik 7y ago
      This is true in general. Kubernetes was ported from Java to Go, though I have no idea how large it was when it happened... that said I agree with you, and it's more likely that a new tool would appear than any of these deciding to suddenly re-write the universe.
    - tracker1 7y ago