This transition from end-to-end differentiable 'black box' systems to multiple networks dedicated to certain tasks working in conjunction is interesting and ver

This transition from end-to-end differentiable 'black box' systems to multiple networks dedicated to certain tasks working in conjunction is interesting and very probably the idea that will keep this field going. We might not fully understand end to end systems in as much detail as we'd like to, but this abstraction layer enables us to at least know what part is doing what, empirically.