It plays tic-tac-toe. There are 304 matchboxes for each possible state in tic-tac-toe[1]. Each match box has three colored beads in it. Different colors indicat

It plays tic-tac-toe. There are 304 matchboxes for each possible state in tic-tac-toe[1]. Each match box has three colored beads in it. Different colors indicate the next move to make. You take the state of the board, find the corresponding matchbox, draw one bead at random out of the box, and make the move. Depending on if the game is a win, loss, or draw, you add or remove beads in the matchboxes to increase or decrease the odds of making that move again. After about 150 games or so, the matchboxes almost always draw against a competent opponent. There is a 1/10 chance that the matchboxes get into a bad state where they can get an empty matchbox. This does not happen in the video. [1] In this scenario, the matchboxes always go first. Letting it go second slightly more than doubles the number of matchboxes.