3 ms·
"FastAPI is not perfect for ML serving" Yup. There's a huge amount of work that you need to do to do the whole ML lifecycle, and FastAPI doesn't support that o
by beckingz 4y ago
"FastAPI is not perfect for ML serving"
Yup. There's a huge amount of work that you need to do to do the whole ML lifecycle, and FastAPI doesn't support that out of the box like a full fledged ML Platform.
But you probably don't actually want a full ML Platform because they're all opinionated and if you try and fight them it's often worse than just serving it as an API via FastAPI...
- alpineidyll3 4y agoYeah... I mean the author is blatantly biased, but his low level discussion is cogent.
- chaoyu_ 4y agoExactly! A vertical solution focused on model serving and deployment would make more sense if it can easily integrate with the ML training platform for CICD