3 ms·
> They did include an 8-rollout version in the tables? I can't say as to why they didn't try using a bigger model than Llama 3 8B. That was a typo. I meant a >
by thethirdone 2y ago
> They did include an 8-rollout version in the tables? I can't say as to why they didn't try using a bigger model than Llama 3 8B.
That was a typo. I meant a > 8 rollout version. It doesn't seem like they have hit massively diminishing returns yet.
> A single rollout is the full process described in chapter 3. "The algorithm iterates through these stages until a termination condition T is met, including rollout constraints or maximum exploration depth"
A rollout is not the entire process. The summary of normal MCTS correctly identifies rollouts as "random simulations by selecting moves arbitrarily until a game’s conclusion is reached, thereby evaluating the node’s potential". Nothing actually like rollouts is ever described.
Typically MCTS is limited by nodes expanded which is likely what they mean, but because they correctly described rollouts, it seems like I am missing something. Also they mention AlphaGo which replaces rollouts with a neural eval which maybe is relevant.
If rollouts means nodes expanded, 4 and 8 are both just really low numbers.