4 ms·
I was a little surprised to see that instead of directly benchmarking prediction performance on a local machine, author chose to go through that complicated web
by captain_price7 7y ago
I was a little surprised to see that instead of directly benchmarking prediction performance on a local machine, author chose to go through that complicated web-server route. I saw author saying this is nothing more than a remote RFC, still, a benchmark should try to remove unrelated factors as much as possible. I would be interested to see how the results compare when this web-service layer is removed.
- cwyers 7y agoServing model predictions via an API is a pretty common usecase for putting data science models in production. If Python's web service layer is slower than Rust's, that's a real concern even if it's not directly related to model prediction.