A sufficiently complicated F can include an intermediary calculation of G for future token steps. This is not explicitly modeled or enforced for LLMs (and doin

A sufficiently complicated F can include an intermediary calculation of G for future token steps. This is not explicitly modeled or enforced for LLMs (and doing so would be interesting) but I'm not sure I could say with any sort of confidence that the network doesn't model these states at some level.