3 ms·
The branching factor for chess is about 35. For token generation, the branching factor depends on the tokenizer, but 32,000 is a common number. Will search be
by spencerchubb 2y ago
The branching factor for chess is about 35.
For token generation, the branching factor depends on the tokenizer, but 32,000 is a common number.
Will search be as effective for LLMs when there are so many more possible branches?
- sdenton4 2y agoYou can pretty reasonably prune the tree by a factor of 1000... I think the problem that others have brought up - difficulty of the value function - is the more salient problem.