6 ms·

64 cores, and it takes 5 minutes? That’s… not awesome. Most people do not have 64 (presumably high performance) cores lying around for the purpose of building d

by OskarS 5y ago

64 cores, and it takes 5 minutes? That’s… not awesome. Most people do not have 64 (presumably high performance) cores lying around for the purpose of building dependencies.

xxpor 5y ago
10 minutes of a c6i.32xlarge costs less than a dollar at on-demand rates in the us-east-2 AWS region. That'll get you 128 vCPUs and 256 gb of memory. I think people put up with a lot of stuff that there's no reason to any more with on-demand computing.
- westurner 5y ago
  Q: "Does my data fit in RAM?" https://news.ycombinator.com/item?id=22309883 https://news.ycombinator.com/item?id=22309883 A: https://yourdatafitsinram.net https://yourdatafitsinram.net Is there a one-liner to build llvm e.g. with k8s and containers, or just a `git push` to a PR? #GitOps And another to publish a locally-signed tagged build? `conda install rust` does install `cargo`. `conda install -c conda-forge -y mamba; mamba install -y rust libllvm14 lit llvm llvm-tools llvmdev` conda-forge/llvmdev-feedstock; ninja, cmake, python >= 3 https://github.com/conda-forge/llvmdev-feedstock/blob/main/recipe/meta.yaml https://github.com/conda-forge/llvmdev-feedstock/blob/main/r... .scripts/run_docker_build.sh is called by build-locally.py: https://github.com/conda-forge/llvmdev-feedstock/blob/main/.scripts/run_docker_build.sh https://github.com/conda-forge/llvmdev-feedstock/blob/main/....
- cesarb 5y ago
  > 10 minutes of a c6i.32xlarge costs less than a dollar at on-demand rates in the us-east-2 AWS region. That assumes you have an AWS account. There are legitimate reasons to not have an AWS account; for instance, you might not want to risk accidentally racking up huge bills, or you might not have access to a payment method AWS accepts, or you might want to avoid using services under USA jurisdiction (due to GDPR concerns or similar).
  - fs111 5y ago
    You can use AWS and be GDPR compliant. What are you talking about?
  - xxpor 5y ago
    AWS was just an easily accessible example. Sub in OVH if you prefer, I'm sure they have similar options for similar prices.
- johnny22 5y ago
  Is there a service that rides on top of aws that offers distcc (or whatever equivalent) or direct pure compile with source uplodate and nothing else? I'd rather pay them than deal with AWS.
- hardware2win 5y ago
  I believe the fact that you propose renting cloud resources just for compilation shows that something aint right Im able to compile c# compiler way faster and with less resources
  - xxpor 5y ago
    I personally work on something written in C and we use bog standard gcc. But when you have 10+ variations to build, tests to run, etc, the parallelism you can get from a bunch of cores makes an enormous difference.

by OskarS 5y ago

64 cores, and it takes 5 minutes? That’s… not awesome. Most people do not have 64 (presumably high performance) cores lying around for the purpose of building dependencies.

xxpor 5y ago

10 minutes of a c6i.32xlarge costs less than a dollar at on-demand rates in the us-east-2 AWS region. That'll get you 128 vCPUs and 256 gb of memory. I think people put up with a lot of stuff that there's no reason to any more with on-demand computing.

westurner 5y ago
Q: "Does my data fit in RAM?" https://news.ycombinator.com/item?id=22309883 https://news.ycombinator.com/item?id=22309883 A: https://yourdatafitsinram.net https://yourdatafitsinram.net Is there a one-liner to build llvm e.g. with k8s and containers, or just a `git push` to a PR? #GitOps And another to publish a locally-signed tagged build? `conda install rust` does install `cargo`. `conda install -c conda-forge -y mamba; mamba install -y rust libllvm14 lit llvm llvm-tools llvmdev` conda-forge/llvmdev-feedstock; ninja, cmake, python >= 3 https://github.com/conda-forge/llvmdev-feedstock/blob/main/recipe/meta.yaml https://github.com/conda-forge/llvmdev-feedstock/blob/main/r... .scripts/run_docker_build.sh is called by build-locally.py: https://github.com/conda-forge/llvmdev-feedstock/blob/main/.scripts/run_docker_build.sh https://github.com/conda-forge/llvmdev-feedstock/blob/main/....
cesarb 5y ago
> 10 minutes of a c6i.32xlarge costs less than a dollar at on-demand rates in the us-east-2 AWS region. That assumes you have an AWS account. There are legitimate reasons to not have an AWS account; for instance, you might not want to risk accidentally racking up huge bills, or you might not have access to a payment method AWS accepts, or you might want to avoid using services under USA jurisdiction (due to GDPR concerns or similar).
- fs111 5y ago
  You can use AWS and be GDPR compliant. What are you talking about?
- xxpor 5y ago
  AWS was just an easily accessible example. Sub in OVH if you prefer, I'm sure they have similar options for similar prices.
johnny22 5y ago
Is there a service that rides on top of aws that offers distcc (or whatever equivalent) or direct pure compile with source uplodate and nothing else? I'd rather pay them than deal with AWS.
hardware2win 5y ago
I believe the fact that you propose renting cloud resources just for compilation shows that something aint right Im able to compile c# compiler way faster and with less resources
- xxpor 5y ago
  I personally work on something written in C and we use bog standard gcc. But when you have 10+ variations to build, tests to run, etc, the parallelism you can get from a bunch of cores makes an enormous difference.