3 ms·
I think they were referring to intermediate tokens in "Thinking" models, which are summarized in the interface but ultimately discarded (and may themselves be s
by maxbond 1y ago
I think they were referring to intermediate tokens in "Thinking" models, which are summarized in the interface but ultimately discarded (and may themselves be summaries of sources, other chats, or earlier intermediate states).
Presumably what's of evidentiary value is the tokens you type, though.