> First, LLMs can actually plan ahead - to a limited degree. Counterintuitive but true. So by the time the indentation is emitted, an LLM can already have somet

> First, LLMs can actually plan ahead - to a limited degree. Counterintuitive but true. So by the time the indentation is emitted, an LLM can already have something of a clue as to what the field names may be, and pick the indentation length accordingly. I think this is a bad explanation. It's like saying that if execution enters a function in your program, the program has planned ahead because the rest of the function exists. The LLM has circuits/basins which are ~guaranteed to emit a certain longer answer once inference has entered them. This is why it's capable of forming words in the first place.