4 ms·
But the LLM can think between writing each token, and indeed can factor in it's own previously written tokens into its answer - thats essentially using a piece
by RugnirViking 1y ago
But the LLM can think between writing each token, and indeed can factor in it's own previously written tokens into its answer - thats essentially using a piece of paper and writing stuff down and referring back to it. Thats the whole idea behind thinking models, and they are demonstrably better at many tasks than others.
- neoden 1y ago> But the LLM can think between writing each token Writing a token is the thinking itself. Thinking models just write some tokens behind the scene, that's the whole difference.