6 ms·
> It would be a bad architecture choice (almost certainly...) Naively, it would seem like transformers could line up nicely with turn-based games. Instead of m
by danenania 2y ago
> It would be a bad architecture choice (almost certainly...)
Naively, it would seem like transformers could line up nicely with turn-based games. Instead of mapping tokens to language as in an LLM, they could map to valid moves given the current game state. And then instead of optimizing the next token for linguistic coherence as LLMs do, you optimize for winning the game.
- danielmarkbruce 2y agoA lot of the games usually used are markov. All the state is right there in front of you, doesn't matter how you got there. As an example - chess - it matters not how you got to state X (... someone will get the edge cases..).