>No it's not. Only Google spends significant time with automatic architecture search, and many people think this is really to try to sell cloud capacity. Maybe

>No it's not. Only Google spends significant time with automatic architecture search, and many people think this is really to try to sell cloud capacity. Maybe not automatic architecture search but a lot does go into testing different architectures and changes to them in a more manual manner. Though yes, those tests are run on a smaller scale so for those huge models, training will be a bigger portion compared to architecture search than for smaller models.