4 ms·
Using GPUs for neural network inference is inefficient and makes no sense, unless there's some hype bubble propping it all up. Maybe sometime in the future a c
by otabdeveloper4 3y ago
Using GPUs for neural network inference is inefficient and makes no sense, unless there's some hype bubble propping it all up.
Maybe sometime in the future a commodity manufacturer of massively parallel CPUs for stupidly parallel tasks appears, but Nvidia ain't it.
- happymellon 3y agoHow many cores/threads would you need to challenge the GPU? Ampere has 320 core chips as a dual socket, although a 4090 might still be cheaper.
- otabdeveloper4 3y ago80% of the effort and cost of a GPU is various bullshit related to rendering DirectX games on Windows.