It's not non-determinism, it's partial information. The NN part guesses the best move that will be found by search X% of the time. If you just ditched the searc

It's not non-determinism, it's partial information. The NN part guesses the best move that will be found by search X% of the time. If you just ditched the search part, Leela would be faster and lose out on (1-X)% of the better moves.