4 ms·
Is compute the limiting factor or data? I see an asymmetry between academia and industry. Academia has the models, industry has the data. Compute is more balan
by jackcosgrove 7y ago
Is compute the limiting factor or data?
I see an asymmetry between academia and industry. Academia has the models, industry has the data. Compute is more balanced because it's usually commodity hardware.
If industry is outpacing academia in research, I think that means data is the more valuable quantity, not compute.
And the article's theme of concentration is more a problem with data. Is Facebook dominant because of its algorithms or because of its database? If other companies had Google's index and user telemetry could they not compete with a rival search algorithm?