Precisely. I remember back in the late 90s, some Particle Physics papers were published that used neural nets to replace hand crafted statistical features. Whi

Precisely. I remember back in the late 90s, some Particle Physics papers were published that used neural nets to replace hand crafted statistical features. While the power was not amazing, I've kind of assumed since then that scale was what would be needed. I then half-way forgot about this, until I saw the results from Alexnet. Since then, the capabilities of the models have generally been keeping up with how they were scaled, at least within about 1 OOM. If that continues, the next 5-20 years are going to be perhaps the most significant in history.