4 ms·
That is because it is thinking out loud. Producing tokens is how it thinks.
by felipeerias 1y ago
That is because it is thinking out loud. Producing tokens is how it thinks.
- eschaton 1y agoProducing tokens is all it does, it’s not thinking.
- NitpickLawyer 1y agoEh, you really have to take the "thinking" in quotes, in the LLM context "thinking" out loud is what makes the results better. I think (hah) their point stands.