4 ms·
If you're loading the model for every prediction, you're doing something really wrong. Pre-processing and post-processing are indeed usually trumping the core c
by mochomocha 5y ago
If you're loading the model for every prediction, you're doing something really wrong. Pre-processing and post-processing are indeed usually trumping the core computation itself, but as you mentioned it's not done in the NN.
- spullara 5y agoCould be something that is just one once per process or the like. But yeah, if you are doing multiple inferences it would be silly to load the model each time.