3 ms·
As someone who has done research in AI, you can train all the state of the art models with a single computer (couple of TitanX GPUs, top of the line CPU, couple
by argonaut 11y ago
As someone who has done research in AI, you can train all the state of the art models with a single computer (couple of TitanX GPUs, top of the line CPU, couple terabyte SSD, 32 GB RAM) that any engineer can afford.
Contrary to popular belief, state of the art deep learning is not commonly run on multi-node clusters. Although hardware itself is not the bottleneck for innovation in the current state of the art in deep learning, if we restrict ourself to hardware, the bottleneck is memory bandwidth.
- Ono-Sendai 11y agoYeah. I guess I was thinking more about some kind of AI that would be similar to human intelligence, as opposed to a specialized pattern recognition algorithm like deep neural networks. I think an AI that is on a human level will need a ton of memory and processing power, and the most obvious way of providing that is to allow for distributed processing over the computers in e.g. a data centre.