5 ms·

I am very tempted to try writing my next paper (maybe a low stake arxiv publication) with ChatGPT. Having done the research and gotten the results, asking it t

I am very tempted to try writing my next paper (maybe a low stake arxiv publication) with ChatGPT. Having done the research and gotten the results, asking it to turn draft paragraphs into properly written text.

j45 4y ago
There’s probably better writing tools to help with that than gpt.
- sebzim4500 4y ago
  Like what? Other than hiring a copy editor, of course.
corobo 4y ago
You've done all the work only to be caught out by automated AI recognition[1] later. Low stakes should probably be fine but to anyone using it for something important at least do the old rewrite-to-not-be-plagiarism trick. I have to imagine there's going to be a lot of people regretting using GPT shortcuts soon. It'll be the equivalent of copy pasting Wikipedia by the end of the year I bet. The next big Google search ranking update should be fun too with all the AI content mills popping up right now. If you see your rival using AI for their blog posts, start writing real content in preparation :D [1] https://openai.com/blog/new-ai-classifier-for-indicating-ai-written-text https://openai.com/blog/new-ai-classifier-for-indicating-ai-...
- Der_Einzige 4y ago
  These watermarking/"detect if someone is AI" techniques are trash, and OpenAI even admits it on their post about this. No proposed or implemented technique outside of this is even close to robust, reliable, or accurate. It is trivial to get around even the best of these techniques. This is a cat and mouse game with a fat, lazy cat and really motivated, olympic tier mice.
  - corobo 4y ago
    I expect this from Reddit but surely Hacker News isn't judging future tech based on current prototypes? Haha None of this existed at all 5 years ago. Let it cook.
    - sebzim4500 4y ago
      Yeah, within a few years there will probably be tools that can reliably detect if a (long) passage was generated by chatGPT or not. I doubt they will be able to tell if the text was generated by whatever will replace chatGPT by that time.
      - corobo 4y ago
        Well then we wait another half year for the 'whatever will replace chatgpt' detector. It's always been a to and fro between spam and ham. Always will be. Unless you're releasing updates to your paper each time a new AI model comes out you're at risk of being caught out if anyone decides to do a "We found 80% of xyz to be AI generated" blog post.
  - WolfOliver 4y ago
    just add "make some common spelling mistakes" at the end of your prompt :D
- WolfOliver 4y ago
  I guess it will be cycle of finding a way around those classifiers and fixing classifiers.
- sebzim4500 4y ago
  >our classifier correctly identifies 26% of AI-written text (true positives) as “likely AI-written,” while incorrectly labeling human-written text as AI-written 9% of the time (false positives) That is... not impressive. I'm honestly surprised that OpenAI was willing to release the tool in this state, it's probably the least reponsible thing they have done since calling themselves "OpenAI". Some kids are going to get expelled for no reason.
  - corobo 4y ago
    If schools start using it, solely it, for plagiarism/cheat detection then I'm right there behind you in the protest. I'd be ok with it being a first line thing that causes a more fine tuned manual check and maybe a manual pop quiz on what the person 'wrote', though. Manual being the key word after AI does its bit.
  - deleted 4y ago
    [deleted]
  - deleted 4y ago
    [deleted]
  - deleted 4y ago
    [deleted]
- cbozeman 4y ago
  This is actually kind of disgusting, because they're simply playing both sides of the fence, and to no real point other than to make money. This doesn't advance us as a species. ChatGPT does. The point of writing is to communicate ideas, thoughts, and feelings. It shouldn't matter if an AI took your ideas, thoughts, feelings, data, experiments, and then amalgamated it into a coherent work from which others can draw meaning.
  - deleted 4y ago
    [deleted]
  - nextaccountic 4y ago
    AI detection is mostly useful to detect signals of fake news
JorgeGT 4y ago
Forget the papers, if this thing writes grant applications...
kergonath 4y ago
I am playing with it right now. Not for results and discussions, but it could be valuable for the introduction fluff, which is very tedious to write, and the methods and techniques, which is very repetitive and for which I sometimes struggle to avoid self-plagiarism and copying and pasting from previous articles.
- sdenton4 4y ago
  Ugh, I tend to think of self plagiarism in methods and techniques sections as a feature, not a bug... No change means no change, after all; so long as the other paper is cited, it's clearer that the methodology is consistent.

j45 4y ago

There’s probably better writing tools to help with that than gpt.

sebzim4500 4y ago
Like what? Other than hiring a copy editor, of course.

corobo 4y ago

You've done all the work only to be caught out by automated AI recognition[1] later. Low stakes should probably be fine but to anyone using it for something important at least do the old rewrite-to-not-be-plagiarism trick. I have to imagine there's going to be a lot of people regretting using GPT shortcuts soon. It'll be the equivalent of copy pasting Wikipedia by the end of the year I bet. The next big Google search ranking update should be fun too with all the AI content mills popping up right now. If you see your rival using AI for their blog posts, start writing real content in preparation :D [1] https://openai.com/blog/new-ai-classifier-for-indicating-ai-written-text https://openai.com/blog/new-ai-classifier-for-indicating-ai-...

Der_Einzige 4y ago
These watermarking/"detect if someone is AI" techniques are trash, and OpenAI even admits it on their post about this. No proposed or implemented technique outside of this is even close to robust, reliable, or accurate. It is trivial to get around even the best of these techniques. This is a cat and mouse game with a fat, lazy cat and really motivated, olympic tier mice.
- corobo 4y ago
  I expect this from Reddit but surely Hacker News isn't judging future tech based on current prototypes? Haha None of this existed at all 5 years ago. Let it cook.
  - sebzim4500 4y ago
    Yeah, within a few years there will probably be tools that can reliably detect if a (long) passage was generated by chatGPT or not. I doubt they will be able to tell if the text was generated by whatever will replace chatGPT by that time.
    - corobo 4y ago
      Well then we wait another half year for the 'whatever will replace chatgpt' detector. It's always been a to and fro between spam and ham. Always will be. Unless you're releasing updates to your paper each time a new AI model comes out you're at risk of being caught out if anyone decides to do a "We found 80% of xyz to be AI generated" blog post.
- WolfOliver 4y ago
  just add "make some common spelling mistakes" at the end of your prompt :D
WolfOliver 4y ago
I guess it will be cycle of finding a way around those classifiers and fixing classifiers.
sebzim4500 4y ago
>our classifier correctly identifies 26% of AI-written text (true positives) as “likely AI-written,” while incorrectly labeling human-written text as AI-written 9% of the time (false positives) That is... not impressive. I'm honestly surprised that OpenAI was willing to release the tool in this state, it's probably the least reponsible thing they have done since calling themselves "OpenAI". Some kids are going to get expelled for no reason.
- corobo 4y ago
  If schools start using it, solely it, for plagiarism/cheat detection then I'm right there behind you in the protest. I'd be ok with it being a first line thing that causes a more fine tuned manual check and maybe a manual pop quiz on what the person 'wrote', though. Manual being the key word after AI does its bit.
- deleted 4y ago
  [deleted]
- deleted 4y ago
  [deleted]
- deleted 4y ago
  [deleted]
cbozeman 4y ago
This is actually kind of disgusting, because they're simply playing both sides of the fence, and to no real point other than to make money. This doesn't advance us as a species. ChatGPT does. The point of writing is to communicate ideas, thoughts, and feelings. It shouldn't matter if an AI took your ideas, thoughts, feelings, data, experiments, and then amalgamated it into a coherent work from which others can draw meaning.
- deleted 4y ago
  [deleted]
- nextaccountic 4y ago
  AI detection is mostly useful to detect signals of fake news

JorgeGT 4y ago

Forget the papers, if this thing writes grant applications...

kergonath 4y ago

I am playing with it right now. Not for results and discussions, but it could be valuable for the introduction fluff, which is very tedious to write, and the methods and techniques, which is very repetitive and for which I sometimes struggle to avoid self-plagiarism and copying and pasting from previous articles.

sdenton4 4y ago
Ugh, I tend to think of self plagiarism in methods and techniques sections as a feature, not a bug... No change means no change, after all; so long as the other paper is cited, it's clearer that the methodology is consistent.