4 ms·

I read this a couple of times and I can't tell how they are sponsoring the Rust Project. Apparently Rust uses some AWS services, are they now getting these for

by Touche 7y ago

I read this a couple of times and I can't tell how they are sponsoring the Rust Project. Apparently Rust uses some AWS services, are they now getting these for free, is that the sponsorship?

arusahni 7y ago
Based on the postscript: > ps – AWS credits are available for other open source projects! it sounds like it
Mathnerd314 7y ago
Yeah, free CI and web hosting. Those are probably the biggest costs in running the project, besides paying developers to work on it. "We’re thrilled that AWS, which the Rust project has used for years, is helping to sponsor Rust’s infrastructure. This sponsorship enables Rust to sustainably host infrastructure on AWS to ship compiler artifacts, provide crates.io crate downloads, and house automation required to glue all our processes together. These services span a myriad of AWS offerings from CloudFront to EC2 to S3. Diversifying the sponsorship of the Rust project is also critical to its long-term success, and we’re excited that AWS is directly aiding this goal." https://aws.amazon.com/blogs/opensource/aws-promotional-credits-open-source-projects/ https://aws.amazon.com/blogs/opensource/aws-promotional-cred...
- fortran77 7y ago
  CI for Rust can be VERY expensive, given the vast amount of CPU and memory the Rust compiler needs. Good for Amazon to handle this important task.
  - ComputerGuru 7y ago
    CI is not run on EC2, MSFT is covering that on Azure.
  - minxomat 7y ago
    Running with sccache drastically reduces build times. I suspect rust is using it to accelerate builds with it's s3 backend. I'm using the Azure storage backend for my GitHub action builds. Even on simple projects (3k LOCs, dozen crates), it cuts more than 60% off the build time.
- pietroalbini 7y ago
  By the way, we don't actually run our CI on AWS. We use S3 to store caches and build artifacts, but all the builds run on Azure Pipelines at the moment.
  - winter_blue 7y ago
    So with this announcement, I assume you’ll be switching to running your CI AWS soon (since it’d be free)?
    - ComputerGuru 7y ago
      Microsoft is providing Azure pipelines to the Rust project free of charge. Switching CI is not trivial, in all cases.
      - steveklabnik 7y ago
        Additionally, we just switched to Azure pipelines after evaluating a number of options. * https://internals.rust-lang.org/t/which-ci-platform-should-rust-use/9322 https://internals.rust-lang.org/t/which-ci-platform-should-r... * https://internals.rust-lang.org/t/update-on-the-ci-investigation/10056 https://internals.rust-lang.org/t/update-on-the-ci-investiga...
    - pietroalbini 7y ago
      Microsoft is already sponsoring our CI on Azure Pipelines, so there would be no need to do that.
Santosh83 7y ago
This comment explains, from the horse's mouth... https://www.reddit.com/r/rust/comments/dhrkit/aws_sponsorship_of_the_rust_project/f3q0d1f/ https://www.reddit.com/r/rust/comments/dhrkit/aws_sponsorshi... PS. The comment on the reddit thread is from one of the co-authors of the blog announcing the sponsorship.
drewm1980 7y ago
Check out crater: https://github.com/rust-lang/crater https://github.com/rust-lang/crater The rust devs recompile a huge chunk of the entire rust ecosystem to make sure new compiler versions don't break things. I can't imagine something like this being even close to feasible in the C++ ecosystem; there is too little standardization of build tooling, too much brittle/broken code. Still it's not cheap and Amazon is paying, bless their hearts and excess compute capacity when it's not Christmas.
- pnako 7y ago
  C++ being a standard, you don't need to rebuild the world to develop your compiler. That being said, there is nothing preventing something similar with C++. In fact, that's pretty much what Linux distributions and BSDs do when upgrading the compiler, see for example https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=240629 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=240629
  - Dylan16807 7y ago
    How it's standardized doesn't matter. And neither language 'needs' it. But it would be just as useful to C++ compiler devs as it is to Rust.

by Touche 7y ago

I read this a couple of times and I can't tell how they are sponsoring the Rust Project. Apparently Rust uses some AWS services, are they now getting these for free, is that the sponsorship?

arusahni 7y ago

Based on the postscript: > ps – AWS credits are available for other open source projects! it sounds like it

Mathnerd314 7y ago

Yeah, free CI and web hosting. Those are probably the biggest costs in running the project, besides paying developers to work on it. "We’re thrilled that AWS, which the Rust project has used for years, is helping to sponsor Rust’s infrastructure. This sponsorship enables Rust to sustainably host infrastructure on AWS to ship compiler artifacts, provide crates.io crate downloads, and house automation required to glue all our processes together. These services span a myriad of AWS offerings from CloudFront to EC2 to S3. Diversifying the sponsorship of the Rust project is also critical to its long-term success, and we’re excited that AWS is directly aiding this goal." https://aws.amazon.com/blogs/opensource/aws-promotional-credits-open-source-projects/ https://aws.amazon.com/blogs/opensource/aws-promotional-cred...

fortran77 7y ago
CI for Rust can be VERY expensive, given the vast amount of CPU and memory the Rust compiler needs. Good for Amazon to handle this important task.
- ComputerGuru 7y ago
  CI is not run on EC2, MSFT is covering that on Azure.
- minxomat 7y ago
  Running with sccache drastically reduces build times. I suspect rust is using it to accelerate builds with it's s3 backend. I'm using the Azure storage backend for my GitHub action builds. Even on simple projects (3k LOCs, dozen crates), it cuts more than 60% off the build time.
pietroalbini 7y ago
By the way, we don't actually run our CI on AWS. We use S3 to store caches and build artifacts, but all the builds run on Azure Pipelines at the moment.
- winter_blue 7y ago
  So with this announcement, I assume you’ll be switching to running your CI AWS soon (since it’d be free)?
  - ComputerGuru 7y ago
    Microsoft is providing Azure pipelines to the Rust project free of charge. Switching CI is not trivial, in all cases.
    - steveklabnik 7y ago
      Additionally, we just switched to Azure pipelines after evaluating a number of options. * https://internals.rust-lang.org/t/which-ci-platform-should-rust-use/9322 https://internals.rust-lang.org/t/which-ci-platform-should-r... * https://internals.rust-lang.org/t/update-on-the-ci-investigation/10056 https://internals.rust-lang.org/t/update-on-the-ci-investiga...
  - pietroalbini 7y ago
    Microsoft is already sponsoring our CI on Azure Pipelines, so there would be no need to do that.

Santosh83 7y ago

This comment explains, from the horse's mouth... https://www.reddit.com/r/rust/comments/dhrkit/aws_sponsorship_of_the_rust_project/f3q0d1f/ https://www.reddit.com/r/rust/comments/dhrkit/aws_sponsorshi... PS. The comment on the reddit thread is from one of the co-authors of the blog announcing the sponsorship.

drewm1980 7y ago

Check out crater: https://github.com/rust-lang/crater https://github.com/rust-lang/crater The rust devs recompile a huge chunk of the entire rust ecosystem to make sure new compiler versions don't break things. I can't imagine something like this being even close to feasible in the C++ ecosystem; there is too little standardization of build tooling, too much brittle/broken code. Still it's not cheap and Amazon is paying, bless their hearts and excess compute capacity when it's not Christmas.

pnako 7y ago
C++ being a standard, you don't need to rebuild the world to develop your compiler. That being said, there is nothing preventing something similar with C++. In fact, that's pretty much what Linux distributions and BSDs do when upgrading the compiler, see for example https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=240629 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=240629
- Dylan16807 7y ago
  How it's standardized doesn't matter. And neither language 'needs' it. But it would be just as useful to C++ compiler devs as it is to Rust.