> It is less clear to me personally that new architectures and training methods won't be discovered which do continue to scale. There are some fascinating rece

> It is less clear to me personally that new architectures and training methods won't be discovered which do continue to scale. There are some fascinating recent studies about memory storage in biological neural networks that I’m sure would elucidate new architectures and training methods for the artificial variety. Multi-phasic layers, etc.