Hard agree with this. Humans are always going to insert human biases into the systems we design, so I think the only way we can really get past those biases is

Hard agree with this. Humans are always going to insert human biases into the systems we design, so I think the only way we can really get past those biases is by going several layers of abstraction deep. I actually suspect that the first AGI will behave eerily organically when we take a look under the hood. Evolution is the ultimate optimization function, and it made organic brains work a certain way based on a cost function. I'll bet we'll see patterns in AGI that remind us of biological brains, but with stark, alien components mixed in and structures reorganized to be more efficient. All in all I'm just incredibly excited to see how this line of research plays out and desperately want to get involved in it myself. I was actually considering learning JAX just the other day specifically so I could look more into the topic, but I'm lazy so I never got around to it.