4 ms·
The heavy lifting done in neural networks is all offloaded to C++ code and the GPU. Very little of the computation time is spent in python. ASICs will definite
by chillee 9y ago
The heavy lifting done in neural networks is all offloaded to C++ code and the GPU. Very little of the computation time is spent in python.
ASICs will definitely be very helpful, and there's currently a bit of a rush to develop them. Google's TPUs might be one of the first efforts, but several other companies and startups are looking to have offerings too.
- davidcuddeback 9y ago> Google's TPUs might be one of the first efforts, but several other companies and startups are looking to have offerings too. NVidia's Volta series includes tensor cores as well [1]. So far, I think they've only released the datacenter version, which is available on EC2 p3 instances [2]. [1] https://www.nvidia.com/en-us/data-center/volta-gpu-architecture/ https://www.nvidia.com/en-us/data-center/volta-gpu-architect... [2] https://aws.amazon.com/ec2/instance-types/p3/#Product_Details https://aws.amazon.com/ec2/instance-types/p3/#Product_Detail...