4 ms·

This looks similar to the internal pipelines framework that all of amazon uses to deploy code. Funny to see truly how much value amazon has gotten out of develo

This looks similar to the internal pipelines framework that all of amazon uses to deploy code. Funny to see truly how much value amazon has gotten out of developing frameworks for the retail business, and then making those frameworks available publicly. The abstractions work because they have already been vetted across amazon for a decade

faizshah 4y ago
I think the last missing piece is getting reproducible builds which I think you can get from buildpacks [0], NixOS [1], or Bazel [2] running in your CodeBuild. [0]: https://buildpacks.io/docs/features/reproducibility/ https://buildpacks.io/docs/features/reproducibility/ [1]: https://nixos.org/ https://nixos.org/ [2]: https://testdriven.io/blog/bazel-builds/ https://testdriven.io/blog/bazel-builds/
- ldjkfkdsjnv 4y ago
  For all its complexity, brazil is amazing
  - fcarraldo 4y ago
    It’s Terry Gilliam’s best work.
  - lkschubert8 4y ago
    What am I missing that makes you feel that way about Brazil?
    - faizshah 4y ago
      There’s no equivalent OSS implementation of a multi language lock file like Brazil’s. You have to build your own or go with a monorepo tool like bazel. Amazonians take reproducibility for granted because of Brazil.
      - slowmovintarget 4y ago
        You're talking "Bazel" right? No "r" pronounced like the herb "basil." Or is there some other framework named "Brazil?" Autocorrect gone viral?
        jcparkyn 4y ago
        Brazil is an internal tool used at Amazon.
      - quag 4y ago
        NixOS is an equivalent and it does not require a mono repo.
        faizshah 4y ago
        I’d be happy if I’m wrong about this but I don’t think you can get a reproducible Node.JS build or python build from NixOS out the box. You need to build something on top of it.
  - faizshah 4y ago
    There was actually an interesting blog post I saw on using content hashing with makefiles: https://andydote.co.uk/2022/09/19/make-content-hash/ https://andydote.co.uk/2022/09/19/make-content-hash/ I was thinking someone could probably build a manyrepo solution similar to Brazil on top of an idea like this. I don’t see many tools like Bazel built for manyrepos.
- ldjkfkdsjnv 4y ago
  A deeply integrated build system with AWS would be very interesting.

faizshah 4y ago

I think the last missing piece is getting reproducible builds which I think you can get from buildpacks [0], NixOS [1], or Bazel [2] running in your CodeBuild. [0]: https://buildpacks.io/docs/features/reproducibility/ https://buildpacks.io/docs/features/reproducibility/ [1]: https://nixos.org/ https://nixos.org/ [2]: https://testdriven.io/blog/bazel-builds/ https://testdriven.io/blog/bazel-builds/

ldjkfkdsjnv 4y ago
For all its complexity, brazil is amazing
- fcarraldo 4y ago
  It’s Terry Gilliam’s best work.
- lkschubert8 4y ago
  What am I missing that makes you feel that way about Brazil?
  - faizshah 4y ago
    There’s no equivalent OSS implementation of a multi language lock file like Brazil’s. You have to build your own or go with a monorepo tool like bazel. Amazonians take reproducibility for granted because of Brazil.
    - slowmovintarget 4y ago
      You're talking "Bazel" right? No "r" pronounced like the herb "basil." Or is there some other framework named "Brazil?" Autocorrect gone viral?
      - jcparkyn 4y ago
        Brazil is an internal tool used at Amazon.
    - quag 4y ago
      NixOS is an equivalent and it does not require a mono repo.
      - faizshah 4y ago
        I’d be happy if I’m wrong about this but I don’t think you can get a reproducible Node.JS build or python build from NixOS out the box. You need to build something on top of it.
- faizshah 4y ago
  There was actually an interesting blog post I saw on using content hashing with makefiles: https://andydote.co.uk/2022/09/19/make-content-hash/ https://andydote.co.uk/2022/09/19/make-content-hash/ I was thinking someone could probably build a manyrepo solution similar to Brazil on top of an idea like this. I don’t see many tools like Bazel built for manyrepos.
ldjkfkdsjnv 4y ago
A deeply integrated build system with AWS would be very interesting.