4 ms·
> being used in ways that would seem idiosyncratic The argument is not that these words are being misused or abused. They're comparing the frequency on the web
by llm_nerd 2y ago
> being used in ways that would seem idiosyncratic
The argument is not that these words are being misused or abused. They're comparing the frequency on the web in general versus the frequency in GPT output, which is not useful or illuminating. For all those words, including delve, the usage is completely cromulent and grammatically correct, but someone needed to spin it into some egregious exploitation.
> an overwhelming effect
Delve was on an upswing for years. Again, it takes just one popular paper to use the phrase "delve into the results" and an army of new papers are going to use the same phrase because we're all stochastic parrots to some degree. Just as Attention Is All You Need has massively influenced countless subsequent papers.
Again, there is zero evidence that ChatGPT even overuses "delve". The guy's evidence that GPTs overuse delve is that it used it a few times and he thinks that's overuse. Okay. Similarly, the evidence that Kenya and/or Nigeria use delve more is just...well it just works with the whole tepid argument okay?
> "delve" being used frequently in countries where the model was trained
The model was trained on TBs of internet data. A small amount of, essentially, "tone" training is done via RLHF, but that wouldn't suddenly make local dialect surface.