6 ms·

Curious - on a scale out of 10, how much of that was written by ChatGPT? No offense intended - if the answer is zero, my apologies

by pdc56 4y ago

precompute 4y ago
I don't think it was written by a LLM, the words have a warmth that generated text lacks. Plus you can tell it's written as if it's half-spoken.
- iLoveOncall 4y ago
  > the words have a warmth that generated text lacks Reminds me of my philosophy teacher in high-school that gave me the best grade of the year and praised how "personal" it felt, for an essay I had bought online for 3 euros. The irony of it still makes me chuckle 15 years later.
  - precompute 4y ago
    Where's the irony?
    - LeonB 4y ago
      The lecturer perceived it to be “personal” implying authentic and genuine, but in truth the essay was the opposite of these things, that is ironic.
      - precompute 4y ago
        Sure, but it was written by a human and not a LLM.
- dmd 4y ago
  > warmth That shows the LLM is running on vacuum tubes.
  - fxtentacle 4y ago
    Perfect. My next business venture is selling ChatGPT text-warming equipment to audiophile readers.
  - kergonath 4y ago
    And gold-plated pure monocrystalline copper connectors.
- m348e912 4y ago
  I think being able to identify LLM generated text would be a nice skill to have, but unfortunately I don't think it's as easy as you think it is.
lisp-pornstar 4y ago
30%, take your bets
PartiallyTyped 4y ago
Imho 9:1 written entirely by human.
have_faith 4y ago
I’ve noticed a large amount of responses from chatgpt start the second/third paragraph with “however, “ or a similar adverb. It will always strive to provide a “balanced” view, even on heavily one sided subjects.
- figassis 4y ago
  I use however a lot
  - eega 4y ago
    Same
- biztos 4y ago
  However, it’s usually more covering its digital ass against the pitchfork-wielding critics than actually balancing the view.
savef 4y ago
https://openai-openai-detector.hf.space/ https://openai-openai-detector.hf.space/ Using this tool on the comment yields a 77.6% fake score. To give (pretty limited) contrast, a response from ChatGPT gives 99.9% fake, and another comment from this thread gives 0.1% fake. I assume that means the comment text was GPT-assisted, with some moderate editing from a human.
- Mistletoe 4y ago
  This is fascinating. I can’t imagine why someone would go to the trouble to do all that for a comment.
  - MonkeyClub 4y ago
    The irony of using a LLM to write a text that complains of the pervasiveness of automated tooling for web design is hard to miss. But perhaps it’s just that the author has internalized copywriting formulas to a degree that their text appears machine generated?
    - Applejinx 4y ago
      We are the hollow men We are the stuffed men Leaning together Headpiece filled with straw. Alas! Our dried voices, when We whisper together Are quiet and meaningless As wind in dry grass Or rats' feet over broken glass In our dry cellar
    - TeMPOraL 4y ago
      Or Reddit. Let's not forget what LLMs are trained on. It's not just Wikipedia and some official text corpora, it's Reddit dumps and other regular Internet conversations. If you learned how to write English on-line, there's a chance you've internalized a style similar to how LLMs often respond. (In fact, I often feel like I sound too much like ChatGPT myself.)
    - sokoloff 4y ago
      The GPT-detector is fascinating (and seemed to work pretty well on some inputs I tested) On the other hand, this next paragraph is scored as 84% fake and I'm quite sure Churchill didn't have Chat-GPT to help: > We shall fight on the beaches, we shall fight on the landing grounds, we shall fight in the fields and in the streets, we shall fight in the hills; we shall never surrender, and even if, which I do not for a moment believe, this island or a large part of it were subjugated and starving, then our Empire beyond the seas, armed and guarded by the British fleet, would carry on the struggle, until, in God's good time, the new world, with all its power and might, steps forth to the rescue and the liberation of the old. IMO, we must not be too quick to conclude that any given text was created/assisted by an LLM based on a scoring algorithm alone. (A low GPT likelihood is probably reliable [for now, until that starts being gamed].) If you offered me even odds, I'd wager that the subject comment was 100% hand-written.
lamontcg 4y ago
I wonder how much of the original reddit post was written by ChatGPT, it seems to tick a lot of boxes.
iamphilrae 4y ago
100% truthfully, I wrote it all myself, but tweaked the opening paragraph with ChatGPT to improve my grammar slightly. It’s a great tool, and one that should not be dismissed, just like spell checkers and the grammar checkers of old in the likes on MS Word. Maybe it does come across a bit ChatGPT-like which is unfortunate I suppose. As for the suggestions of me asking it to write the comment from prompts, then I’m afraid that’s 100% wrong.

Curious - on a scale out of 10, how much of that was written by ChatGPT? No offense intended - if the answer is zero, my apologies

by pdc56 4y ago

Curious - on a scale out of 10, how much of that was written by ChatGPT? No offense intended - if the answer is zero, my apologies

precompute 4y ago

I don't think it was written by a LLM, the words have a warmth that generated text lacks. Plus you can tell it's written as if it's half-spoken.

iLoveOncall 4y ago
> the words have a warmth that generated text lacks Reminds me of my philosophy teacher in high-school that gave me the best grade of the year and praised how "personal" it felt, for an essay I had bought online for 3 euros. The irony of it still makes me chuckle 15 years later.
- precompute 4y ago
  Where's the irony?
  - LeonB 4y ago
    The lecturer perceived it to be “personal” implying authentic and genuine, but in truth the essay was the opposite of these things, that is ironic.
    - precompute 4y ago
      Sure, but it was written by a human and not a LLM.
dmd 4y ago
> warmth That shows the LLM is running on vacuum tubes.
- fxtentacle 4y ago
  Perfect. My next business venture is selling ChatGPT text-warming equipment to audiophile readers.
- kergonath 4y ago
  And gold-plated pure monocrystalline copper connectors.
m348e912 4y ago
I think being able to identify LLM generated text would be a nice skill to have, but unfortunately I don't think it's as easy as you think it is.

lisp-pornstar 4y ago

30%, take your bets

PartiallyTyped 4y ago

Imho 9:1 written entirely by human.

have_faith 4y ago

I’ve noticed a large amount of responses from chatgpt start the second/third paragraph with “however, “ or a similar adverb. It will always strive to provide a “balanced” view, even on heavily one sided subjects.

figassis 4y ago
I use however a lot
- eega 4y ago
  Same
biztos 4y ago
However, it’s usually more covering its digital ass against the pitchfork-wielding critics than actually balancing the view.

savef 4y ago

https://openai-openai-detector.hf.space/ https://openai-openai-detector.hf.space/ Using this tool on the comment yields a 77.6% fake score. To give (pretty limited) contrast, a response from ChatGPT gives 99.9% fake, and another comment from this thread gives 0.1% fake. I assume that means the comment text was GPT-assisted, with some moderate editing from a human.

Mistletoe 4y ago
This is fascinating. I can’t imagine why someone would go to the trouble to do all that for a comment.
- MonkeyClub 4y ago
  The irony of using a LLM to write a text that complains of the pervasiveness of automated tooling for web design is hard to miss. But perhaps it’s just that the author has internalized copywriting formulas to a degree that their text appears machine generated?
  - Applejinx 4y ago
    We are the hollow men We are the stuffed men Leaning together Headpiece filled with straw. Alas! Our dried voices, when We whisper together Are quiet and meaningless As wind in dry grass Or rats' feet over broken glass In our dry cellar
  - TeMPOraL 4y ago
    Or Reddit. Let's not forget what LLMs are trained on. It's not just Wikipedia and some official text corpora, it's Reddit dumps and other regular Internet conversations. If you learned how to write English on-line, there's a chance you've internalized a style similar to how LLMs often respond. (In fact, I often feel like I sound too much like ChatGPT myself.)
  - sokoloff 4y ago
    The GPT-detector is fascinating (and seemed to work pretty well on some inputs I tested) On the other hand, this next paragraph is scored as 84% fake and I'm quite sure Churchill didn't have Chat-GPT to help: > We shall fight on the beaches, we shall fight on the landing grounds, we shall fight in the fields and in the streets, we shall fight in the hills; we shall never surrender, and even if, which I do not for a moment believe, this island or a large part of it were subjugated and starving, then our Empire beyond the seas, armed and guarded by the British fleet, would carry on the struggle, until, in God's good time, the new world, with all its power and might, steps forth to the rescue and the liberation of the old. IMO, we must not be too quick to conclude that any given text was created/assisted by an LLM based on a scoring algorithm alone. (A low GPT likelihood is probably reliable [for now, until that starts being gamed].) If you offered me even odds, I'd wager that the subject comment was 100% hand-written.

lamontcg 4y ago

I wonder how much of the original reddit post was written by ChatGPT, it seems to tick a lot of boxes.

iamphilrae 4y ago

100% truthfully, I wrote it all myself, but tweaked the opening paragraph with ChatGPT to improve my grammar slightly. It’s a great tool, and one that should not be dismissed, just like spell checkers and the grammar checkers of old in the likes on MS Word. Maybe it does come across a bit ChatGPT-like which is unfortunate I suppose. As for the suggestions of me asking it to write the comment from prompts, then I’m afraid that’s 100% wrong.