I've only built relatively small, POC applications, but I've been using flask to host an API that gets called by whatever application. It depends on how often

I've only built relatively small, POC applications, but I've been using flask to host an API that gets called by whatever application. It depends on how often you want to update your model, how complex it is, how much data it requires to infer, etc. I think splitting up the services/code will be helpful if we get to the point where there are multiple teams working on this stuff.