3 ms·
In theory, but what if we did see a difference :)
by scrapheap 3y ago
In theory, but what if we did see a difference :)
- kolinko 3y agoNo, it's practice. The model doesn't change day by day. Kind of like saying "let's watch the same youtube video every day and see if it changes" - it won't, that's not how youtube works, there is no point trying.
- kevindamm 3y agoOn the one hand, I suspect OpenAI does stealth updates of the model sometimes, or adjustments to the chat product. On the other hand, even move-fast-and-break-things mentality knows that some of December should be in production freeze, emergency-only updates.
- kolinko 3y agoMost people have that suspicion, myself included. But the API models stay verifiably same, and also OpenAI would have little reason to lie about not updating ChatGPT. Otoh, I can easily imagine helper/censorship models and chat’s system prompt being updated. System prompt doesn’t change capabilities much though, and the censor model behaviour doesn’t change the output, just cuts it off when it discovers copyright or other violations (the case of chat not being able to recite the Dune poem, DALLe not being able to produce certain images etc)