3 ms·
People in 1999 weren't running huge neural nets and beating the world champion in Go. There are millions of computers in data centers around the world. They a
by haberman 11y ago
People in 1999 weren't running huge neural nets and beating the world champion in Go.
There are millions of computers in data centers around the world. They are working on problems that someone thought it was worthwhile enough to pay for. If C compilers emit code that is slower, that means buying and maintaining a lot more computers, using more energy, producing more greenhouse gas, etc.
- dragontamer 11y ago> People in 1999 weren't running huge neural nets and beating the world champion in Go. Which was mostly GPU code, so it was either CUDA or OpenCL btw. Not actually C. People do need to realize that the fastest, massively parallel supercomputers are in fact written in CUDA / OpenCL. And the most powerful supercomputers are mostly being used to display 3d-models of a sword-wielder fighting a guy with guns.
- haberman 11y agoFair enough. But some very significant fraction of the hardware and energy spent on data centers today is on CPUs.