Yeah but will it satisfy us, if we can't see it making analogies, can't see its semantics; identify with it? This same lack of breakdown into pieces we understa

Yeah but will it satisfy us, if we can't see it making analogies, can't see its semantics; identify with it? This same lack of breakdown into pieces we understand will make it hard to tweak and advance NNs beyond 'good categorizers'.