3 ms·
My guess is that it isn't doing a lot of self-interaction. I've been using it for coding, and the replies feel much too coherent to be either: 1. expanded from
by sdwr 3y ago
My guess is that it isn't doing a lot of self-interaction. I've been using it for coding, and the replies feel much too coherent to be either:
1. expanded from an outline (2-stage process)
or
2. being chained between models
If it was multi-stage, I'd expect some chinese whispers-style drift, where the plot gets lost slightly between steps. The responses I'm getting from GPT4 are focused and specific.
Likewise, if the responses were getting chained between models, I'd expect visible seams in tone / content in between.
My guess for how they're architecturing it, if it is 8 models, is either:
1. Each response handled by 1 model
or
2. Some kind of voting / confidence system that switches between models on the fly