I think understanding how neural networks work is easiest if you think of them as networks. Reasoning about why they work is a lot easier thinking about them as

I think understanding how neural networks work is easiest if you think of them as networks. Reasoning about why they work is a lot easier thinking about them as transformations. It's not like you're actually picturing all the parameters of a nontrivial network one way or the other.