3 ms·
Assuming the researcher didn't lie, it seems unlikely that they got the responses wrong in some way. The most likely alternative explanation I can think of is
by danpalmer 3y ago
Assuming the researcher didn't lie, it seems unlikely that they got the responses wrong in some way.
The most likely alternative explanation I can think of is that this is the seemingly well know instability of results caused by the way the MoE architecture is implemented for GPT-4?
I'd love to understand what exactly is wrong in my understanding. I realise I've only got a layman's understanding of this, but it seems clear that OpenAI and others depend on these feedback loops to improve things over time. Is that not the case?
- ralusek 3y agoIt is explicitly known the the training data cutoff for GPT4 is September 2021. While we can assume that feedback is taken into consideration for future training of new models, the training data used to train all current models is a specific bundle of data with that cutoff date.