IIRC there's also a particular combination of settings, not demonstrated in the post here, where it won't just give you output layer nonsense, but latent model

IIRC there's also a particular combination of settings, not demonstrated in the post here, where it won't just give you output layer nonsense, but latent model nonsense — i.e. streams of information about lexeme part-of-speech categorizations. Which really surprised me, because it would never occur to me that LLMs store these in a way that's coercible to text.