As a very concrete "major advance" consider Google Translate's tiny language models [1] that can beam to your phone, live in a few megabytes, and translate phot

As a very concrete "major advance" consider Google Translate's tiny language models [1] that can beam to your phone, live in a few megabytes, and translate photographed text for you with low power usage. This was done with incredibly expensive centralized training, but checks every meaningful box for "scalable" AI. [1] https://ai.googleblog.com/2015/07/how-google-translate-squeezes-deep.html https://ai.googleblog.com/2015/07/how-google-translate-squee...