Python is the de-facto default and main language in data science and ML community. You start because it is easy and have a great ecosystem but then after some t

Python is the de-facto default and main language in data science and ML community. You start because it is easy and have a great ecosystem but then after some time you start to worry about performance at some point. And it takes time, efforts and money to re-write in rust,C++.. etc. I think running inference engines is one particular case of that. You can train and tweak your model using python with its wonderful pytorch and numpy. Then at some point when scale and performance matter then this becomes a potential problem.