3 ms·
I'm not sure I agree with that and I'm one of the biggest ai pessimists here. The gpus getting created to do this shit aren't just gonna get thrown out (maybe s
by __loam 3y ago
I'm not sure I agree with that and I'm one of the biggest ai pessimists here. The gpus getting created to do this shit aren't just gonna get thrown out (maybe sold in a fire sale), and they're pretty general purpose. Tons of science needs massive compute.
- otabdeveloper4 3y agoUsing GPUs for neural network inference is inefficient and makes no sense, unless there's some hype bubble propping it all up. Maybe sometime in the future a commodity manufacturer of massively parallel CPUs for stupidly parallel tasks appears, but Nvidia ain't it.
- happymellon 3y agoHow many cores/threads would you need to challenge the GPU? Ampere has 320 core chips as a dual socket, although a 4090 might still be cheaper.
- otabdeveloper4 3y ago80% of the effort and cost of a GPU is various bullshit related to rendering DirectX games on Windows.