2 ms·
> In my opinion, Python needs to have an urgent answer to the use of multiple cores. Subinterpreters are an answer (heck, so is multiprocessing). Whether betw
by dragonwriter 3y ago
> In my opinion, Python needs to have an urgent answer to the use of multiple cores.
Subinterpreters are an answer (heck, so is multiprocessing).
Whether between them they are enough for Python's domains is another question. Probably not for the long term, but possibly for the neart term. But anything more is going to be a big lift, no-GIL is the obvious broader answer, so its good its being worked on, because by the time its betond question that its needed, it’ll be too late to start working in earnest.
- dalf 3y agoFor now the suggested communication protocol is: * os.pipe and serialization (pickle or whatever): https://peps.python.org/pep-0554/#synchronize-using-an-os-pipe https://peps.python.org/pep-0554/#synchronize-using-an-os-pi... * immortal object, but I don't see a way to create immortal object from Python (only from C). https://engineering.fb.com/2023/08/15/developer-tools/immortal-objects-for-python-instagram-meta/ https://engineering.fb.com/2023/08/15/developer-tools/immort... I guess it will more iteration to get a better way to communicate between the interpreters.