> Therefore I don't think it has any clue about the 3D world of the game at all. AI models don't "know" things at all. At best, they're just very fuzzy predic

> Therefore I don't think it has any clue about the 3D world of the game at all. AI models don't "know" things at all. At best, they're just very fuzzy predictors. In this case, given the last couple frames of video and a user input, it predicts the next frame. It has zero knowledge of the game world, game rules, interactions, etc. It's merely a mapping of [pixels, input] -> pixels.