3 ms·
Today, we are releasing an updated GPT-4 Turbo preview model, gpt-4-0125-preview. This model completes tasks like code generation more thoroughly than the previ
by anotherpaulg 3y ago
Today, we are releasing an updated GPT-4 Turbo preview model, gpt-4-0125-preview. This model completes tasks like code generation more thoroughly than the previous preview model and is intended to reduce cases of “laziness” where the model doesn’t complete a task.
The new GPT-4 Turbo is intended to reduce laziness. I'm updating aider's existing laziness benchmark now.
EDIT: Preliminary results are up.
Overall,
the new `gpt-4-0125-preview` model does worse on the lazy coding benchmark
as compared to the November `gpt-4-1106-preview` model.
https://aider.chat/docs/benchmarks-0125.html https://aider.chat/docs/benchmarks-0125.html
- fakedang 3y agoI suspect that this has been underway a long time. GPT-4 today seems as good as GPT-3 was in 2022 for most text generation tasks. Lots of answers seem cached-in-memory in some form, then regurgitated and adjusted for different user queries - recent answers seem to follow a template, as compared to organic generation (which is also computationally expensive). I have a feeling they're purposely reducing the quality of the models, and possibly even relaunching older models as SOTA to show "progress".
- ametrau 3y ago“To answer your question about chatgpts progress it’s necessary to…” (proceeds to list what it’s going to do instead of doing it). Gosh that gets annoying
- ComplexSystems 3y agoThanks! Would be great to get a comparison of the two models.
- wahnfrieden 3y agoReminds me of Whisper v3 performing far worse than v2 with hallucinations
- deleted 3y ago[deleted]