And adding some more here. I don't know if any models doing this but there is the possibility of generating tokens that it does not show to the user. I think

And adding some more here. I don't know if any models doing this but there is the possibility of generating tokens that it does not show to the user. I think there's quite a lot of scope for internal monologue/chain of thought that could provide concise but clever answers. The difficulty in this is the latency while it ponders to itself, but having played with the groq demos. I think there's scope for a decent interactive experience. The concern people might feel when they realise an ai might have private thoughts is another issue entirely.