Training requires millions of games. playing against humans is only for evaluation purposes, not for training. In both cases, it was indeed a static model but

Training requires millions of games. playing against humans is only for evaluation purposes, not for training. In both cases, it was indeed a static model but more recent work which is called MuZero is not static and achieves great results in board games and atari.