4 ms·
And pay in memory for that luxury: when using lots of complex libraries (like in ML) the Python process can eat quite a lot of RAM.
by klibertp 6y ago
And pay in memory for that luxury: when using lots of complex libraries (like in ML) the Python process can eat quite a lot of RAM.
- globular-toast 6y agoYes. Python is not without tradeoffs.
- viraptor 6y agoSince gc.freeze() got implemented (https://docs.python.org/3/library/gc.html#gc.freeze https://docs.python.org/3/library/gc.html#gc.freeze) having forked workers has much lower cost these days. As long as you can load your data pre-fork that is.
- klibertp 6y agoWow, I missed its introduction. Nice. On a cursory glance Celery doesn't make use of it yet, unfortunately.