As far as I'm aware, we are yet to create a complex simulation or game as rich as the world around us. That said, even if we could, games often have somewhat we

As far as I'm aware, we are yet to create a complex simulation or game as rich as the world around us. That said, even if we could, games often have somewhat well-defined fitness functions. The other problem with simulated problem spaces is as the other comment suggests, you can on purpose or accidentally introduce all sorts of biases. "Our robot got smarter and it was left-wing", well, you did simulate it living in Silicon Valley. "Our AI got smarter and it was right-wing", well, you did simulate it living in a small Texas town as a priest. As it happens, these AIs are currently being created Silicon Valley companies that are known to have a left-wing bias. So if any bias from the creators was to filter into the training system, we may have some idea in which direction it pushes.