But being fundamental in this context is a bad thing. It's not like there is a single "neural" architecture that's getting better and better. There are dozens

But being fundamental in this context is a bad thing. It's not like there is a single "neural" architecture that's getting better and better. There are dozens of different architectures with their own optimizations, shortcuts, functions and parameters.