Regardless of the architecture, you would still need the model server for online serving use cases. And you’re right that it’s best to decouple the validation/p

Regardless of the architecture, you would still need the model server for online serving use cases. And you’re right that it’s best to decouple the validation/preprocessing logic from the model runtime from architecture perspective, and that’s exactly what BentoML does but a regular web framework can not do.