8 ms·
Programming on Parallel Machines; GPU, Multicore, Clusters and More
- infocollector 3y agoFor anyone who knows both R and Python well - Request: I think it would be nice to translate this book into Python from R.
- gauku 3y agoThe book is in C, not R
- deleted 3y ago[deleted]
- mateuspires 3y agoIt says R there. There is even a chapter named "Why R" explaining why R was the choose language for the book.
- reactordev 3y agoPage 321 goes into how to translate R things to C/C++ things. It’s trivial to do the same for python. ChatGPT could do it.
- jsyang00 3y agoIs MPI still widely used?
- nine_k 3y agoWhat would replace it?
- eismcc 3y agoChapel[0] was created, in part to replace MPI in HPC communities. However, MPI remains dominant. [0] https://chapel-lang.org/ https://chapel-lang.org/
- lunfard000 3y agoI dont expect a new PL to replace a library anytime soon.
- bradcray 3y agoI would say Chapel was created less to replace MPI and more to provide a higher-level alternative to it that is amenable to compiler optimization.
- deleted 3y ago[deleted]
- deleted 3y ago[deleted]
- necheffa 3y agoMPI is industry standard at this point.
- pjmlp 3y agoWhen I was in the university is what still pretty much PVM vs MPI fighting for attention. I bet no one remembers what PVM was all about now.
- sweetjuly 3y agoIf you feel like you've finally groked GPU/massive parallel software programming and need more challenges, I highly recommend playing around with digital circuits! The level of parallelism available to you in hardware is truly unmatched and it's incredibly fun, especially once you start really pushing implementations of your designs on FPGAs. Granted, FPGAs are frequently less useful than what you could do on a GPU due to the higher clock speeds available on ASICs (if your GPU core clock is 3GHz and your FPGA design maxes out at 500MHz [which would be admirable!], the GPU has nearly 6x the number of cycles to match or beat your implementation!).
- shihab 3y agoHow do you get started with that?
- naitgacem 3y agohave a look into hardware descriptive languages, VHDL or verilog and go from there
- Vilian 3y agoHow is the best way to programm with them?, IDE or LSP?
- Twisol 3y agoThe OSS CAD Suite [0] is a good open-source toolchain for this stuff. You can then write hardware designs in the SytemVerilog language (VSCode has some plugins, I believe, but I've just been using a basic text editor) and use the build toolchain to compile ("synthesize") and program e.g. an FPGA with your designs. (FWIW, I've only just taken a class on Verilog this past Spring, but we used oss-cad-suite and I found it pretty straightforward to use. The bundled version of Verilator had some issues on my Mac though, so I had to compile my own copy of Verilator.) [0] https://github.com/YosysHQ/oss-cad-suite-build/ https://github.com/YosysHQ/oss-cad-suite-build/
- 3y ago
- JZL003 3y agoI know it depends on the analysis, but I often am doing somewhat embarassingly parallel things. So just knowing GNU parallel for mid-scale things (and R/python basically parallelism, although shared memory is a bear), and how to temporarily scale across the cloud to like 500 core, is huge.
- bee_rider 3y ago500 cores is just a handful of nodes nowadays. Living in the future is weird.
- fragmede 3y agoFwiw, a single u-12tb1.112xlarge has 448 cores.
- fbdab103 3y agoWoof, $109/hour on demand pricing (~$950k/year on demand, ~$590k/1year reserved). Super curious what a similar spec machine would retail.
- up2isomorphism 3y agoThe problem is you will need to hire 10 guys to use that machine well. And that easily costs you 2M a year.
- latchkey 3y ago
- deleted 3y ago[deleted]
- spiritplumber 3y agoI like the Parallax Propeller for this if you need a microcontroller. $8 for 8 cores.
- lincpa 3y ago[dead]