4 ms·
Yeah. Python is pretty standard now. To implement high throughput scoring on models written in python, I have to run multiple processes with one copy of the pyt
by bhntr3 9y ago
Yeah. Python is pretty standard now. To implement high throughput scoring on models written in python, I have to run multiple processes with one copy of the python model for each process. For large models like random forests, this can eat up a lot of memory.
Ideally, it would be a single model in memory with access from multiple threads. But that won't work right now cause GIL.