It really depends. For sure there are models which should be processed in the background. It is a very basic tutorial that shows how simple ML models can be use

It really depends. For sure there are models which should be processed in the background. It is a very basic tutorial that shows how simple ML models can be used as REST API. In the tutorial I was using Random Forest trained on UCI Adult Income data set. The final model was small, and computing predictions was fast. I would love to add more advanced part of the tutorial with background processing for large models.