4 ms·
FYI, OpenAI has denied that there have been any unannounced changes to the models. And it seems more than possible that people see what they want to see in LL
by deeviant 3y ago
FYI, OpenAI has denied that there have been any unannounced changes to the models.
And it seems more than possible that people see what they want to see in LLM output. So I would be careful to make completely unsupported claims.
- ineedasername 3y agoSure but they could be playing with semantics a bit as well. When they say "models" they might just mean the LLM that it's all based on. But there's a long more going on in the pipeline to turn that into a consumer facing service like ChatGPT. They might have changed any combination of the following: 1) Fine Tuning 2) Embedding 3) The initializing prompt 4) Filtering a prompt prior to ingestion & tokenization of the prompt 5) Filtering the output from the application after it has generated a response. The statement "we have no unannounced changes to the models" can be true while still substantially changing functionality & response quality through any of the 5 above areas, and probably some I missed.
- qumpis 3y agoI'd be so pleasantly surprised if the same model has remained the same. Everytime I see speedups in its generation speed I assume they've distilled the model further. The outputs subjectively also feel weaker. Surely someone has compared the outputs from the beginning and now?