4 ms·
OP here, I was thinking more CPU for inference. Training happens elsewhere on GPUs.
by martindbp 6y ago
OP here, I was thinking more CPU for inference. Training happens elsewhere on GPUs.
- yandie 6y agoJust mean that you'll need to deal with latency, either through provisioned capacity lambda or build it into your service SLA :)