3 ms·
CPU training was and continues to be one-tenth of the speed, dollar for dollar. It's not even close. The inescapable trend is that bigger models are better mod
by freeone3000 4y ago
CPU training was and continues to be one-tenth of the speed, dollar for dollar. It's not even close.
The inescapable trend is that bigger models are better models. So if you're doing this professionally, you're going to need GPUs not only for training, but increasingly for inference in order to get decent latency.
- geysersam 4y agoOn the other hand, it's likely competition will catch up to Nvidia. They were early and good. But the space is too lucrative, and the technology is not special enough that they will be able to keep their dominant position for long.