...one can probably try to use smth like genetic algorithms to select/refine the N-1 layers ...current neural networks take the architecture to be fixed or at l

...one can probably try to use smth like genetic algorithms to select/refine the N-1 layers ...current neural networks take the architecture to be fixed or at least "given" (by some outside process, which might itself be an NN, but still). We'll probably need a way to break out of this fixed/given architecture mode for next level breakthroughs. Smth like "differentiating through architecture-space too"... (guess the marketing dpts. will call it "profound deep learning" or something even cheesier :P) (But I'm totally clueless as to whether Numenta is doing anything useful on this or getting anywhere useful with what they're doing ...no time to research this and kind of way above my current knowledge and understanding :))