3 ms·

Delve is indeed a word that I've seen for decades, but never in grade grubbing emails from students until about a year ago. "I would like to delve into why I th

by viccis 2y ago

Delve is indeed a word that I've seen for decades, but never in grade grubbing emails from students until about a year ago. "I would like to delve into why I think my 45% should be a B- ...", etc. I would imagine that those other words (which seem very common to me) are being used in ways that would seem idiosyncratic to an American English speaker. Like I see tapestry all the time in very flowery language ("The country has a rich tapestry of influences ..."), but I would be amused if I read it being used to describe contents of a backlog at work. I will disagree strongly with this: >That words come into or out of favour in some realm like papers on PubMed by itself proves little and isn't particularly demonstrative. This is ignoring what appears to be an overwhelming effect (an increase of around 1250%) that kicked off with ChatGPT's inception. I don't think you outlined adequate grounds for ignoring this as unrelated, given the timing, the magnitude, and the ready explanation of "delve" being used frequently in countries where the model was trained.

llm_nerd 2y ago
> being used in ways that would seem idiosyncratic The argument is not that these words are being misused or abused. They're comparing the frequency on the web in general versus the frequency in GPT output, which is not useful or illuminating. For all those words, including delve, the usage is completely cromulent and grammatically correct, but someone needed to spin it into some egregious exploitation. > an overwhelming effect Delve was on an upswing for years. Again, it takes just one popular paper to use the phrase "delve into the results" and an army of new papers are going to use the same phrase because we're all stochastic parrots to some degree. Just as Attention Is All You Need has massively influenced countless subsequent papers. Again, there is zero evidence that ChatGPT even overuses "delve". The guy's evidence that GPTs overuse delve is that it used it a few times and he thinks that's overuse. Okay. Similarly, the evidence that Kenya and/or Nigeria use delve more is just...well it just works with the whole tepid argument okay? > "delve" being used frequently in countries where the model was trained The model was trained on TBs of internet data. A small amount of, essentially, "tone" training is done via RLHF, but that wouldn't suddenly make local dialect surface.

by viccis 2y ago

llm_nerd 2y ago

> being used in ways that would seem idiosyncratic The argument is not that these words are being misused or abused. They're comparing the frequency on the web in general versus the frequency in GPT output, which is not useful or illuminating. For all those words, including delve, the usage is completely cromulent and grammatically correct, but someone needed to spin it into some egregious exploitation. > an overwhelming effect Delve was on an upswing for years. Again, it takes just one popular paper to use the phrase "delve into the results" and an army of new papers are going to use the same phrase because we're all stochastic parrots to some degree. Just as Attention Is All You Need has massively influenced countless subsequent papers. Again, there is zero evidence that ChatGPT even overuses "delve". The guy's evidence that GPTs overuse delve is that it used it a few times and he thinks that's overuse. Okay. Similarly, the evidence that Kenya and/or Nigeria use delve more is just...well it just works with the whole tepid argument okay? > "delve" being used frequently in countries where the model was trained The model was trained on TBs of internet data. A small amount of, essentially, "tone" training is done via RLHF, but that wouldn't suddenly make local dialect surface.