3 ms·
Eh, ChatGPT uses phrases like "it's important to remember" because they were common in the training data. The rest of the sentence definitely isn't ChatGPT: >
by lolinder 3y ago
Eh, ChatGPT uses phrases like "it's important to remember" because they were common in the training data. The rest of the sentence definitely isn't ChatGPT:
> It's important to remember that while Wikipedia is "The Free Encyclopedia that Anyone Can Edit," it's hardly The Wild West.
My reading is that the article is average human prose (not great, not unreadable), not LLM prose.
- EGreg 3y agoIf I play GM-level chess moves from Rybka or AlphaZero randomly on average every 5 moves on average, could you tell?
- AndyNemmity 3y agoEvery 5 moves, yes. But as most Chess Grandmasters say, you only really need to use it in one difficult spot to change the result of a game.
- ummonk 3y agoNah. I play the top engine move like half the time and I'm not a particularly strong player.
- staunton 3y agoBoth can be true at the same time. A lot of the time the best move is obvious. However, if you play the top move 20% of the time, you will also play the top move in a lot of cases where it's not obvious. Given enough games, it's detectable.
- seanmcdirmid 3y agoI wonder if ChatGPT was trained on too many high school essays. It’s not very good writing style, but it’s what most people start out writing.
- jameshart 3y ago> My reading is that the article is average human prose. Which is, of course, exactly what ChatGPT is trained to produce. A lot of people's mental AI detector is actually a mediocrity detector.
- famouswaffles 3y agoNo GPT is trained to spit out anything that falls into its training data distribution. There's no average. Pre-training incentives being able to predict the smartest string of text in the corpus as readily as the dumbest. It doesn't converge on "average" and it doesn't really make sense that it would either. Base models don't talk like GPT. This is strictly an artifact of post training fine-tuning/RLHF.
- famouswaffles 3y ago>My reading is that the article is average human prose (not great, not unreadable), not LLM prose. It's not average human prose either(for one thing expecting GPT to converge on some average doesn't really make sense in the first place). Base models with no rlhf or fine-tuning don't talk like that at all. This is specifically an artifact of the post-training fine-tuning/RLHF process
- lolinder 3y agoI never said that I expected ChatGPT to converge on an average, I said that this particular phrase is not strong evidence by itself of GPT authorship. "It's important to remember" is a phrase that plenty of people used before ChatGPT. I've included three examples below from a quick time-boxed search. Just because ChatGPT says a phrase doesn't mean that every time you see it it came from ChatGPT—someone wrote the training data that ChatGPT was trained on, and someone else wrote the data (or selected the responses) that it was fine tuned on. ChatGPT isn't inventing new phrases out of whole cloth, it has a stereotyped style that is pieced together out of many existing phrases. A collection of such stereotyped phrases in a single piece would be stronger evidence of GPT authorship, but I see no evidence of that here. https://old.reddit.com/r/gravityfalls/comments/bgtnez/while_alex_hirsch_is_amazing_its_important_to/ https://old.reddit.com/r/gravityfalls/comments/bgtnez/while_... https://twitter.com/AsteadWH/status/1050813462673264640 https://twitter.com/AsteadWH/status/1050813462673264640 https://stackoverflow.blog/2019/12/19/what-senior-developers-can-learn-from-beginners/ https://stackoverflow.blog/2019/12/19/what-senior-developers...
- famouswaffles 3y agoI think I misunderstood you then. Fair Enough.
- MattDaEskimo 3y agoMy theory is that this phrase was baked in during alignment training to ensure the model prints out any necessary warnings. "It's important to remember to consult a mechanic" for example. It's just some priming.