2 ms·
> Python for the last few years is that you cannot take advantage of multiple cores of a CPU easily. Same thing in the R ecosystem, it's possible to use multip
by ekianjo 6y ago
> Python for the last few years is that you cannot take advantage of multiple cores of a CPU easily.
Same thing in the R ecosystem, it's possible to use multiple cores with the parallel package but there are caveats too.
- curiousgal 6y agoI haven't run into any issues with that package honestly (mclapply ftw!). Other than not being able to use it on Windows of course.
- gbrown 6y agoIt’s process based, so communication overhead is heavy and the infrastructure is minimal - if you’re distributing jobs which are individually large it works fine, but it can’t really be used to replace multithreading in a shared memory model.
- clircle 6y agoI do as much data work as possible in data.table, which parallelizes things under the hood, and doesn't seem to require me to configure anything.