39 ms·
>My reading is that the article is average human prose (not great, not unreadable), not LLM prose. It's not average human prose either(for one thing expecting
by famouswaffles 3y ago
>My reading is that the article is average human prose (not great, not unreadable), not LLM prose.
It's not average human prose either(for one thing expecting GPT to converge on some average doesn't really make sense in the first place).
Base models with no rlhf or fine-tuning don't talk like that at all. This is specifically an artifact of the post-training fine-tuning/RLHF process
- lolinder 3y agoI never said that I expected ChatGPT to converge on an average, I said that this particular phrase is not strong evidence by itself of GPT authorship. "It's important to remember" is a phrase that plenty of people used before ChatGPT. I've included three examples below from a quick time-boxed search. Just because ChatGPT says a phrase doesn't mean that every time you see it it came from ChatGPT—someone wrote the training data that ChatGPT was trained on, and someone else wrote the data (or selected the responses) that it was fine tuned on. ChatGPT isn't inventing new phrases out of whole cloth, it has a stereotyped style that is pieced together out of many existing phrases. A collection of such stereotyped phrases in a single piece would be stronger evidence of GPT authorship, but I see no evidence of that here. https://old.reddit.com/r/gravityfalls/comments/bgtnez/while_alex_hirsch_is_amazing_its_important_to/ https://old.reddit.com/r/gravityfalls/comments/bgtnez/while_... https://twitter.com/AsteadWH/status/1050813462673264640 https://twitter.com/AsteadWH/status/1050813462673264640 https://stackoverflow.blog/2019/12/19/what-senior-developers-can-learn-from-beginners/ https://stackoverflow.blog/2019/12/19/what-senior-developers...
- famouswaffles 3y agoI think I misunderstood you then. Fair Enough.