3 ms·
I feel that they've added a classifier model, where it will determine whether a satisfactory answer to a prompt will require the full model or a smaller one. Th
by atleastoptimal 3y ago
I feel that they've added a classifier model, where it will determine whether a satisfactory answer to a prompt will require the full model or a smaller one. This leads to the inconsistent quality of outputs: some are really from a worse model that the system believes it can get away with and still be "GPT-4" quality. When it takes a long time to get an answer from GPT-4, it seems better, but worse when it's unexpectedly fast.
- nojs 3y agoI think this is very likely. It seems like OpenAI is throwing everything at trying to get GPT4 to scale, and this is one of the things they’re experimenting with.