4 ms·

I meant you don't need to feed it your corpus if it's good enough at mimicking styles. Just ask to mimic someone else. I don't mean novelty like pirate or shake

I meant you don't need to feed it your corpus if it's good enough at mimicking styles. Just ask to mimic someone else. I don't mean novelty like pirate or shakespeare. Mimic "a student with average ability". Then ask to ramp up authenticity. Or even use some model or service with this built in so you don't even need to write any prompts. Zero effort You're saying it's not good enough at mimicking styles. others saying it's good enough. I think if it's not good enough today it'll be good enough tomorrow. Are you betting on it not becoming good enough?

hnlmorg 2y ago
I’m betting on it not becoming good enough at mimicking a specific students style without having access to their specific work. Teachers will notice if students writing style shifts in one piece compared to another. Nobody disputes that you can get LLMs to mimic other people. However it cannot mimic a specific style it hasn’t been trained on. And very few people who are going to cheat are going to take the time to train an LLM on their writing style since the entire point of plagiarism is to avoid doing work.
- throwaway290 2y ago
  How would the teacher know what student's style is if she always uses the LLM? Also do you expect that student's style is fixed forever or teachers are all so invested that they can really tell when the student is trying something new vs use an LLM that was trained to output writing in the style of an average student? Imagine the teacher saying "this is not your style it's too good" to a student who legit tried killing any motivation to do anything but cheat for remaining life
  - hnlmorg 2y ago
    > How would the teacher know what student's style is if she always uses the LLM? If the student always uses LLMs then it would be pretty obvious by the fact that they’re failing at the cause in all bar the written assessments (ie the stuff they can cheat on). > Also do you expect that student's style is fixed forever Of course not. But people’s styles don’t change dramatically on one paper and reset back afterwards. > teachers are all so invested that they can really tell when the student is trying something new vs use an LLM that was trained to output writing in the style of an average student? Depends on the size of the classes. When I was at college I do know that teachers did check for changes in writing styles. I know this because one of the kids on my class was questioned about his changes in his writing style. With time, I’m sure anti-cheat software will also check again previous works by the students to check for changes in style. However this was never my point. My point was that cheaters wouldn’t bother training on their own corpus. You keep pushing the conversation away from that. > Imagine the teacher saying "this is not your style it's too good" to a student who legit tried killing any motivation to do anything but cheat for remaining life That’s how literally no good teacher would ever approach the subject. Instead they’d talk about how good the paper was and ask about where the inspiration came from.
    - famouswaffles 2y ago
      >If the student always uses LLMs then it would be pretty obvious by the fact that they’re failing at the cause in all bar the written assessments (ie the stuff they can cheat on). There's nothing stopping students from generating an essay and going over it. >Of course not. But people’s styles don’t change dramatically on one paper and reset back afterwards. Takes just a little effort to avoid this. >With time, I’m sure anti-cheat software will also check again previous works by the students to check for changes in style. That's never going to happen. Probably because it doesn't make any sense. What's a change in writing style ? Who's measuring that ? And why is that an indicator of cheating ? >However this was never my point. My point was that cheaters wouldn’t bother training on their own corpus. You keep pushing the conversation away from that. Training is not necessary in any technical sense. A decent sample of your writing in the context is more than good enough. Probably most cheaters wouldn't bother but some certainly would.
      - hnlmorg 2y ago
        > There's nothing stopping students from generating an essay and going over it. This then comes back to my original point. If they learn the content and rewrite the output, is it really plagiarism? > Takes just a little effort to avoid this. That depends entirely on the size of the coursework. > That's never going to happen. Probably because it doesn't make any sense. What's a change in writing style ? Who's measuring that ? And why is that an indicator of cheating ? This entire article and all the conversations that followed are about using writing styles to spot plagiarism. It’s not a new concept nor a claim I made up. So if you don’t agree with this premise then it’s a little late in the thread to be raising that disagreement. > Training is not necessary in any technical sense. A decent sample of your writing in the context is more than good enough. Probably most cheaters wouldn't bother but some certainly would. I think you’d need a larger corpus than the average cheater would be bothered to do. But I will admit I could be waaay off in my estimations of this.
        famouswaffles 2y ago
        >This then comes back to my original point. If they learn the content and rewrite the output, is it really plagiarism? Who said anything about rewriting? That's not necessary. You can have GPT write your essay and all you do is study it afterwards, maybe ask questions etc. You've saved hours of time and yes that would still be cheating and plagiarism by most. >This entire article and all the conversations that followed are about using writing styles to spot plagiarism. It’s not a new concept nor a claim I made up. >So if you don’t agree with this premise then it’s a little late in the thread to be raising that disagreement. The article is about piping essays into black box neural networks that you can at best hypothesize is looking for similarities between the presented writing and some nebulous "AI" style. It's not comparing styles between your past works and telling you just cheated because of some deviation. That's never going to happen. >I think you’d need a larger corpus than the average cheater would be bothered to do. But I will admit I could be waaay off in my estimations of this. An essay or two in the context window is fine. I think you underestimate just what SOTA LLMs are capable of. You don't even need to bother with any of that if all you want is a consistent style. A style prompt with a few instructions to deviate from GPT's default writing style is sufficient. My point is that it's not this huge effort to have generated writing that doesn't yo-yo in writing style between essays.

hnlmorg 2y ago

I’m betting on it not becoming good enough at mimicking a specific students style without having access to their specific work. Teachers will notice if students writing style shifts in one piece compared to another. Nobody disputes that you can get LLMs to mimic other people. However it cannot mimic a specific style it hasn’t been trained on. And very few people who are going to cheat are going to take the time to train an LLM on their writing style since the entire point of plagiarism is to avoid doing work.

throwaway290 2y ago
How would the teacher know what student's style is if she always uses the LLM? Also do you expect that student's style is fixed forever or teachers are all so invested that they can really tell when the student is trying something new vs use an LLM that was trained to output writing in the style of an average student? Imagine the teacher saying "this is not your style it's too good" to a student who legit tried killing any motivation to do anything but cheat for remaining life
- hnlmorg 2y ago
  > How would the teacher know what student's style is if she always uses the LLM? If the student always uses LLMs then it would be pretty obvious by the fact that they’re failing at the cause in all bar the written assessments (ie the stuff they can cheat on). > Also do you expect that student's style is fixed forever Of course not. But people’s styles don’t change dramatically on one paper and reset back afterwards. > teachers are all so invested that they can really tell when the student is trying something new vs use an LLM that was trained to output writing in the style of an average student? Depends on the size of the classes. When I was at college I do know that teachers did check for changes in writing styles. I know this because one of the kids on my class was questioned about his changes in his writing style. With time, I’m sure anti-cheat software will also check again previous works by the students to check for changes in style. However this was never my point. My point was that cheaters wouldn’t bother training on their own corpus. You keep pushing the conversation away from that. > Imagine the teacher saying "this is not your style it's too good" to a student who legit tried killing any motivation to do anything but cheat for remaining life That’s how literally no good teacher would ever approach the subject. Instead they’d talk about how good the paper was and ask about where the inspiration came from.
  - famouswaffles 2y ago
    >If the student always uses LLMs then it would be pretty obvious by the fact that they’re failing at the cause in all bar the written assessments (ie the stuff they can cheat on). There's nothing stopping students from generating an essay and going over it. >Of course not. But people’s styles don’t change dramatically on one paper and reset back afterwards. Takes just a little effort to avoid this. >With time, I’m sure anti-cheat software will also check again previous works by the students to check for changes in style. That's never going to happen. Probably because it doesn't make any sense. What's a change in writing style ? Who's measuring that ? And why is that an indicator of cheating ? >However this was never my point. My point was that cheaters wouldn’t bother training on their own corpus. You keep pushing the conversation away from that. Training is not necessary in any technical sense. A decent sample of your writing in the context is more than good enough. Probably most cheaters wouldn't bother but some certainly would.
    - hnlmorg 2y ago
      > There's nothing stopping students from generating an essay and going over it. This then comes back to my original point. If they learn the content and rewrite the output, is it really plagiarism? > Takes just a little effort to avoid this. That depends entirely on the size of the coursework. > That's never going to happen. Probably because it doesn't make any sense. What's a change in writing style ? Who's measuring that ? And why is that an indicator of cheating ? This entire article and all the conversations that followed are about using writing styles to spot plagiarism. It’s not a new concept nor a claim I made up. So if you don’t agree with this premise then it’s a little late in the thread to be raising that disagreement. > Training is not necessary in any technical sense. A decent sample of your writing in the context is more than good enough. Probably most cheaters wouldn't bother but some certainly would. I think you’d need a larger corpus than the average cheater would be bothered to do. But I will admit I could be waaay off in my estimations of this.
      - famouswaffles 2y ago
        >This then comes back to my original point. If they learn the content and rewrite the output, is it really plagiarism? Who said anything about rewriting? That's not necessary. You can have GPT write your essay and all you do is study it afterwards, maybe ask questions etc. You've saved hours of time and yes that would still be cheating and plagiarism by most. >This entire article and all the conversations that followed are about using writing styles to spot plagiarism. It’s not a new concept nor a claim I made up. >So if you don’t agree with this premise then it’s a little late in the thread to be raising that disagreement. The article is about piping essays into black box neural networks that you can at best hypothesize is looking for similarities between the presented writing and some nebulous "AI" style. It's not comparing styles between your past works and telling you just cheated because of some deviation. That's never going to happen. >I think you’d need a larger corpus than the average cheater would be bothered to do. But I will admit I could be waaay off in my estimations of this. An essay or two in the context window is fine. I think you underestimate just what SOTA LLMs are capable of. You don't even need to bother with any of that if all you want is a consistent style. A style prompt with a few instructions to deviate from GPT's default writing style is sufficient. My point is that it's not this huge effort to have generated writing that doesn't yo-yo in writing style between essays.