3 ms·
I'm tempted to agree with Carmack here, having worked at a now-defunct self driving project previously that used multiple server-grade GPUs and many-core CPUs p
by b9a2cab5 5y ago
I'm tempted to agree with Carmack here, having worked at a now-defunct self driving project previously that used multiple server-grade GPUs and many-core CPUs pulling 1000+W in their car that couldn't even figure out how to move around a car that was parallel parked too far out in the road.
More teraflops are not what is needed.
- modeless 5y agoI mean, I partially agree with his opinions from those tweets, but my conclusions are still different. Firstly, the AGI of the future may well be able to be distilled to a form that would fit on a top supercomputer of today. But developing an AGI is going to need a whole lot more power than running an optimized version after the fact. And secondly, the flexibility and availability of GPUs is hard to beat, but I think that after a few iterations of datacenter-scale hardware we'll learn what's needed to really make it shine. So maybe the first iteration of Dojo won't be much better than a GPU cluster in practice, but the third or fourth could be spectacular.