2 ms·

My understanding is that the main limitation of LLM is that their are single pass. I.e. they process once and return they answer. If that answer is correct that

My understanding is that the main limitation of LLM is that their are single pass. I.e. they process once and return they answer. If that answer is correct that's great but if they answer doesn't make sense LLM has no ability to retrace steps. That is exactly why breaking into steps is useful, because each step is easier to quickly answer. I think at some point people will combine the LLM with some kind of LLM-critic that will enable automatic splitting into steps or reruns of the LLM.

pona-a 2y ago
> ...If they answer doesn't make sense LLM has no ability to retrace the steps. Beam search already exists, it precisely allows the model to backtrack on its past tokens and find the global maxima of probability, at least within set depth/breadth. I think this is just a larger limitation of their shallow world model. Perhaps giving transformers registers will remedy this.