2 ms·
Silicon is likely fine as a material. GPU cost per operation is still dropping insanely quickly. A lot of really hard ML problems are just making big things fea
by 6gvONxR4sf7o 5y ago
Silicon is likely fine as a material. GPU cost per operation is still dropping insanely quickly. A lot of really hard ML problems are just making big things feasible, or sampling big things enough to get decently precise estimates. With 10x the GPU power and memory, a lot of this gets easy. With 100x, some hard things get trivial. At the end of the day, GPUs and TPUs drive AI research more than anything else as models grow massively.