4 ms·
Could someone more knowledgeable please comment if this is Windows only? And if yes, could the mods append (Windows) to the submission title?
by shiven 12y ago
Could someone more knowledgeable please comment if this is Windows only? And if yes, could the mods append (Windows) to the submission title?
- trentnelson 12y agoThere are two components to PyParallel: the alternate approach to async I/O afforded by Windows and IOCP, and the changes to CPython that facilitate multiple interpreter threads running simultaneously in parallel. The latter is, at a conceptual level, not limited to Windows. The proof-of-concept implementation that pairs the two concepts is Windows-only, at the moment, because Windows simply has better out-of-the-box scaffolding for this sort of stuff: https://speakerdeck.com/trent/parallelizing-the-python-interpreter-the-quest-for-true-multi-core-concurrency?slide=26 https://speakerdeck.com/trent/parallelizing-the-python-inter... As for non-Windows implementations, there are other operating systems out there that provide similar primitives: AIX copied the IOCP API from Windows verbatim, Solaris has event ports, and OS X got GCD. I'd love to see the Linux kernel provide semantically equivalent primitives. You simply can't achieve the same affect without kernel-level thread dispatching support tied into the mix (https://speakerdeck.com/trent/parallelism-and-concurrency-with-python?slide=27 https://speakerdeck.com/trent/parallelism-and-concurrency-wi...).
- shiven 12y agoThank you for explaining that! So, theoretically OSX could use this paradigm assuming PyParallel is (re?)written making use of GCD? How likely do you feel this will happen and sooner/later?
- trentnelson 12y agoYup, OS X wouldn't be that hard to port to at all as all the primitives I need are provided already by the OS. Vastly different APIs so still a bit of code needed, but definitely viable. I'd love to see that happen before the year is out :-)