2 ms·
What useful models run at decent speed on a CPU these days? Even basic image classifiers tend to be 100x faster on a GPU or TPU...
by londons_explore 8y ago
What useful models run at decent speed on a CPU these days?
Even basic image classifiers tend to be 100x faster on a GPU or TPU...
- bitL 8y agoInference is not that super slow on CPU, especially for network requests that already have quite a bit of latency, so plenty of companies use CPUs on the cloud for lambda/flexible loads where GPUs aren't available.