4 ms·
> Otherwise what innovation are you talking about? Quantity: Google has the highest number of deep learning papers accepted into top conferences among all inst
by netheril96 8y ago
> Otherwise what innovation are you talking about?
Quantity: Google has the highest number of deep learning papers accepted into top conferences among all institutions, even when papers from DeepMind are not counted in Google's.
Quality: Transformer and the recent BERT have, pun intended, transformed the entire NLP field. Batch normalization is now a staple of all neural networks, as are its descendants instance normalization, group normalization, etc.
These are just on top of my head. Google may have done many things wrong these days, but it definitely has not lost any edge in machine learning.
- vl 8y agoWhile I don't know real numbers, back of the enveloper estimations for hardware costs alone (based on GCP TPU/GPU pricing) give order of hundreds thousands for BERT, and tens of millions for AlphaGo and friends. Notice how very few organizations in the world are in position to commit these kind of resources to AI problems, and that only Google and China are choosing to do so.
- netheril96 8y agoAnd? Most scientific breakthroughs after the World War II require expensive equipments and materials. That fact doesn't make the achievements from Google, from Bell Labs, from CERN, from Fermilab less innovative.