2 ms·
I'm sorry, but why would you run a model like ALBERT on a CPU in the first place? It's pretty common to run inference on CPUs. There are lots of operational an
by nl 7y ago
I'm sorry, but why would you run a model like ALBERT on a CPU in the first place?
It's pretty common to run inference on CPUs. There are lots of operational and cost reasons why this makes sense in at least some cases.
- peterjussi 7y agoI would even say: in every case, except where a GPU or TPU is necessary to achieve a certain speed. Unless there are very specific reasons for it, GPU/TPU is just unnecessarily cost inefficient.