3 ms·
I see that you accept models up to 1 GB. It seems the inference time might be high for models of this size on CPUs. Do you use GPUs to speed up inference for de
by ebalit 6y ago
I see that you accept models up to 1 GB. It seems the inference time might be high for models of this size on CPUs. Do you use GPUs to speed up inference for deep learning models ?
- theo31 6y agoWe don’t offer GPU accelerated inference for now. However it’s on our roadmap, sign up for inferrd to get updates!