It's kind of like the argument against trying understand the brain by modeling one: ok, so let's say you have a perfect model, all that's left is to understand

It's kind of like the argument against trying understand the brain by modeling one: ok, so let's say you have a perfect model, all that's left is to understand your model. Or another way I've heard it explained. If we were trying to understand Mario and could perfectly emulate its circuit, would that translate into us understanding the concept of saving the princess? Probably not, we'd probably venture a guess that collecting coins is the most important thing in the game.