I would argue that a decent human player also has "similar sequences of moves in its training set", due to reading plus playing or watching games. The illegal

I would argue that a decent human player also has "similar sequences of moves in its training set", due to reading plus playing or watching games. The illegal move argument is good though, and indicates no direct understanding of what it is spewing out.