3 ms·

I'm not sure what you want me to do with that information; clearly I do think that my description is accurate. The article is littered with both AI tells and a

I'm not sure what you want me to do with that information; clearly I do think that my description is accurate. The article is littered with both AI tells and admissions that 'next token prediction' is what is happening. Hence my description.

garrinm 1mo ago
It was written by a human. There are AI edits but it’s very much a human composition. Perhaps a bit sloppy.
- Planktonne 1mo ago
  In my experience, people who do 'AI-assisted' writing tend to be very bad at noticing how much of their work AI has changed. I'm sure you put thought into it, but passing it through AI takes a lot of that out.
  - garrinm 1mo ago
    I think that’s fair, I didn’t actually run the whole thing through an AI. it was more targeted edits, but each time it does erode at my writing. But at the same time, I don’t think it’s a good reason to dismiss this. Because I did spend several hours writing it, and I did put a lot of thought into it, and it was not in any meaningful way generated by AI.
    - Planktonne 1mo ago
      Mostly I disagree with the article's ideas, if that helps; the AI was just a secondary factor. > I don’t think it’s a good reason to dismiss this AI-generated prose reads as sending a 'lack of effort' signal to a lot of people, just as no editing at all does. ; It's an effective heuristic that we've all learnt in the last couple of years. In either case, it's not always fair: there are people who deeply care about their ideas but forget to fix basic errors, or pass it through AI. In both cases though, the advice is the same: if you want people to take your output seriously, you need to signal that you are taking it seriously. That used to mean editing for spelling and grammar. Now it means not using AI.
    - zahlman 1mo ago
      Out of curiousity, do you ask your editing system for diffs? Seems to me like the best way to notice and review whether your "voice" is degrading. Personally I would never let an LLM touch my prose (although I'd happily use it for research and paraphrase things it told me), but if I force myself to consider the idea, that seems like the first thing I'd want. Maybe upon reading a diff you'd even consider going a third way with the text.
zahlman 1mo ago
> I'm not sure what you want me to do with that information For example, you could cite specific things that you believe to be "AI tells" or "admissions".
- Planktonne 1mo ago
  It's a short article; you could read it. One example to get you started is the very first sentence: > Strictly speaking, the statement “LLMs are next-token predictors” isn’t wrong, but it’s incomplete. The article is about how 'next-token predictor' is the wrong mental model; it opens with the admission that it is not the wrong mental model.
  - zahlman 1mo ago
    I did read it. People are allowed to disagree with your conclusions. Comment guidelines ask us all not to make such accusations. To say that a statement is incomplete, but not strictly speaking wrong, is perfectly compatible with describing it informally as "wrong" in the sense used in the title (i.e.: "not the most appropriate possibility").
    - Planktonne 1mo ago
      To informally describe something as wrong in an article focused on how it's wrong to informally describe something is incoherent. There's a certain irony in pointing me towards the guidelines on the grounds that I have limited patience with your comments that violate them in various ways. I'm not sure that this is a productive discussion.
- angoragoats 1mo ago
  Not the person you’re replying to, but I read the whole article as an admission that it’s still a next-token predictor. More specifically: what does RLVR fundamentally change that somehow makes the whole process no longer a next-token predictor? The article makes no attempt to explain this. Additionally, I find its framing of the term “next-token predictor” as meaning “predicting the next token only based on raw training data” in common usage to be a bit dishonest. To summarize: yes, RLVR and other synthetic training methods exist! It’s still a next-token predictor, and it does not “learn” or “think” or “reason” in the human sense, like so many people seem to believe.

garrinm 1mo ago

It was written by a human. There are AI edits but it’s very much a human composition. Perhaps a bit sloppy.

Planktonne 1mo ago
In my experience, people who do 'AI-assisted' writing tend to be very bad at noticing how much of their work AI has changed. I'm sure you put thought into it, but passing it through AI takes a lot of that out.
- garrinm 1mo ago
  I think that’s fair, I didn’t actually run the whole thing through an AI. it was more targeted edits, but each time it does erode at my writing. But at the same time, I don’t think it’s a good reason to dismiss this. Because I did spend several hours writing it, and I did put a lot of thought into it, and it was not in any meaningful way generated by AI.
  - Planktonne 1mo ago
    Mostly I disagree with the article's ideas, if that helps; the AI was just a secondary factor. > I don’t think it’s a good reason to dismiss this AI-generated prose reads as sending a 'lack of effort' signal to a lot of people, just as no editing at all does. ; It's an effective heuristic that we've all learnt in the last couple of years. In either case, it's not always fair: there are people who deeply care about their ideas but forget to fix basic errors, or pass it through AI. In both cases though, the advice is the same: if you want people to take your output seriously, you need to signal that you are taking it seriously. That used to mean editing for spelling and grammar. Now it means not using AI.
  - zahlman 1mo ago
    Out of curiousity, do you ask your editing system for diffs? Seems to me like the best way to notice and review whether your "voice" is degrading. Personally I would never let an LLM touch my prose (although I'd happily use it for research and paraphrase things it told me), but if I force myself to consider the idea, that seems like the first thing I'd want. Maybe upon reading a diff you'd even consider going a third way with the text.

zahlman 1mo ago

> I'm not sure what you want me to do with that information For example, you could cite specific things that you believe to be "AI tells" or "admissions".

Planktonne 1mo ago
It's a short article; you could read it. One example to get you started is the very first sentence: > Strictly speaking, the statement “LLMs are next-token predictors” isn’t wrong, but it’s incomplete. The article is about how 'next-token predictor' is the wrong mental model; it opens with the admission that it is not the wrong mental model.
- zahlman 1mo ago
  I did read it. People are allowed to disagree with your conclusions. Comment guidelines ask us all not to make such accusations. To say that a statement is incomplete, but not strictly speaking wrong, is perfectly compatible with describing it informally as "wrong" in the sense used in the title (i.e.: "not the most appropriate possibility").
  - Planktonne 1mo ago
    To informally describe something as wrong in an article focused on how it's wrong to informally describe something is incoherent. There's a certain irony in pointing me towards the guidelines on the grounds that I have limited patience with your comments that violate them in various ways. I'm not sure that this is a productive discussion.
angoragoats 1mo ago
Not the person you’re replying to, but I read the whole article as an admission that it’s still a next-token predictor. More specifically: what does RLVR fundamentally change that somehow makes the whole process no longer a next-token predictor? The article makes no attempt to explain this. Additionally, I find its framing of the term “next-token predictor” as meaning “predicting the next token only based on raw training data” in common usage to be a bit dishonest. To summarize: yes, RLVR and other synthetic training methods exist! It’s still a next-token predictor, and it does not “learn” or “think” or “reason” in the human sense, like so many people seem to believe.