4 ms·
If you are trying to compare the performance as a ML service, maybe you should try to compare it with other ML model serving frameworks like https://github.com/
by urcyanide 4y ago
If you are trying to compare the performance as a ML service, maybe you should try to compare it with other ML model serving frameworks like https://github.com/mosecorg/mosec https://github.com/mosecorg/mosec or https://github.com/bentoml/BentoML https://github.com/bentoml/BentoML. Flask/FastAPI are not built for ML services.