3 ms·
I don't think that needs for running neural networks will emerge in datacentres. The demand is too low. Nor is the FPGA the best thing to run them on. Even if
by baybal2 8y ago
I don't think that needs for running neural networks will emerge in datacentres. The demand is too low.
Nor is the FPGA the best thing to run them on. Even if you "bake" them into static integer models, that can be mapped directly to gates, that only possible for the smallest ones around. GPUs are pretty much what is the best as it is: an accelerator for doing a lot of low precision linear algebra.
And as a side benefit, you can play Quake on all those GTXes pressed into linear algebra crunching in datacentres. Jokes aside, being able to resell server hardware later on is a very good thing. Moreover, the sole fact that gaming industry is magnitude bigger than whatever happens in HPC will be the guarantor of (relatively) low prices.
- p1esk 8y agoFPGAs are much better than current GPUs for low precision NN computation (binary or ternary). Nvidia knows that (that's why they introduced experimental INT1 mode on their latest cards).