4 ms·
I know it depends on the analysis, but I often am doing somewhat embarassingly parallel things. So just knowing GNU parallel for mid-scale things (and R/python
by JZL003 3y ago
I know it depends on the analysis, but I often am doing somewhat embarassingly parallel things. So just knowing GNU parallel for mid-scale things (and R/python basically parallelism, although shared memory is a bear), and how to temporarily scale across the cloud to like 500 core, is huge.
- bee_rider 3y ago500 cores is just a handful of nodes nowadays. Living in the future is weird.
- fragmede 3y agoFwiw, a single u-12tb1.112xlarge has 448 cores.
- fbdab103 3y agoWoof, $109/hour on demand pricing (~$950k/year on demand, ~$590k/1year reserved). Super curious what a similar spec machine would retail.
- up2isomorphism 3y agoThe problem is you will need to hire 10 guys to use that machine well. And that easily costs you 2M a year.
- latchkey 3y ago448 logical processors. Each logical processor is a hyperthread on 224 cores. A logical processor is the number of the processor's cores multiplied by the number of threads per core. 2 threads per core.
- formerly_proven 3y agovCPUs are not cores and those are "new 2021" instances based on freakin Skylake. Yikes. Green-IT, huh?