It's interesting how we use one learning tool (our brain) to understand another. There is a question about what is the goal of learning mechanics: SGD already w

It's interesting how we use one learning tool (our brain) to understand another. There is a question about what is the goal of learning mechanics: SGD already works well enough and making it a few times better will still not answer fundamental questions about what the black boxes do (rather than how they learn), because in many ways our brains are also black boxes. I think this was missing some links from learning mechanics to psychology and indeed philosophical ideas about the nature of thought and language.