I think we can be pretty confident GPT-4 isn't doing something like this based on its performance characteristics. i) The complexity of the prompt/answer does

I think we can be pretty confident GPT-4 isn't doing something like this based on its performance characteristics. i) The complexity of the prompt/answer does not effect the time per token. ii) We start getting a response pretty quickly (for short prompts) and then get new tokens at a roughly constant rate I don't think either of these properties would hold if there were a bunch of models that had to coordinate before they could start writing the output. Certainly techniques like ToT violate them.