I just want to be able to deploy a flask app that responds to a lot of CPU-intensive requests (making inference from ML models) that takes advantage of modern C

I just want to be able to deploy a flask app that responds to a lot of CPU-intensive requests (making inference from ML models) that takes advantage of modern CPUs that have a stupid number of cores, without having to pay the memory overhead of duplicating the entire process' memory space N-times. Native threads would totally fix this inefficiency but the GIL breaks it. Java and .Net would be more appropriate in this production environment but they don't have the same eco-system of packages and we also don't want to pay the development cost of re-writing people's notebooks into another language and all the problems that entails. So instead, our server VMs consume a ton of unnecessary memory. /rant