4 ms·

EDIT: Oh, wow. Lack of coffee this morning. I read that as "fictional mythology", NOT "fictional methodology." Ignore me. :) ----- I want to pull apart one s

by davely 3y ago

EDIT: Oh, wow. Lack of coffee this morning. I read that as "fictional mythology", NOT "fictional methodology." Ignore me. :) ----- I want to pull apart one specific thing you mentioned, essentially: > It seems totally unclear whether ChatGPT is being used to invent fictional methodology [...], which is extremely unethical In the context of generating something fictional, why is using ChatGPT unethical? One reason I'm asking: I have always been a big fan of NaNoWriMo[1] (National Novel Writing Month, every November). This year, I'm interested in exploring how to use ChatGPT -- not necessarily to generate a ton of prose, but to essentially help flesh out some plot ideas that I've had. Part of the back and forth I've had with it is coming up with some interesting scenarios for my story that I hadn't really thought about and I'm keen on exploring a bit more. [1] https://en.wikipedia.org/wiki/National_Novel_Writing_Month https://en.wikipedia.org/wiki/National_Novel_Writing_Month

mola 3y ago
Because this fiction is presented as part of a scientific paper....
- davely 3y ago
  I am a ding dong. I read that as "fictional mythology" and my mind immediately went down a different rabbit hole. Yes, I see now why that would be unethical.
SubiculumCode 3y ago
its unethical because its not being published as fiction, but of science.
dghlsakjg 3y ago
Methodology isn’t supposed to ever be fictional is the problem.
- WendyTheWillow 3y ago
  But ChatGPT isn’t deciding to use fictional methodology in its paper, it’s being asked to generate a fictional methodology and complying. The human is the problem in that scenario, not the LLM. The unethical choice happens at the point of deciding to lie about methodology, before LLM is involved. It may seem like a meaningless distinction, but it’s the difference between LLMs causing trouble and people causing trouble, which is important for the larger debate.
  - anonymous_sorry 3y ago
    Not meaningless, but a little obvious. I don't think anyone was accusing ChatGPT of being duplicitous. I think one problem with LLMs and the hype around them is that people are placing far too much confidence in them, and therefore misuse them. That it's even conceivable that people might blame a tool for unethical behaviour is an indicator of this. The idea that an LLM would be able to correctly generate your methodology for you is another. I find ChatGPT simultaneously incredible and terrible. It has no concept of what it knows and what it doesn't, so there's nothing I would trust it to do without a human checking the output.
  - circuit10 3y ago
    This reminds me of when I asked it to generate a fake research paper describing how my dog is the best in the world as a joke and it refused because apparently creating fake research papers is unethical, even when it’s an obvious joke. I asked again in a new chat and it made me a really nice one with funny things like a formula showing the amount of force he uses to open doors and fake data proving statistically that he is the best
- davely 3y ago
  Yes, I agree. I misread the word. My apologies!
circuit10 3y ago
They mean generating fictional methodology and then passing it off as real in a scientific paper is unethical. This is also unethical if you don’t use ChatGPT, of course
- davely 3y ago
  Ah! Misunderstanding on my part. I see. Thank you!

by davely 3y ago

mola 3y ago

Because this fiction is presented as part of a scientific paper....

davely 3y ago
I am a ding dong. I read that as "fictional mythology" and my mind immediately went down a different rabbit hole. Yes, I see now why that would be unethical.

SubiculumCode 3y ago

its unethical because its not being published as fiction, but of science.

dghlsakjg 3y ago

Methodology isn’t supposed to ever be fictional is the problem.

WendyTheWillow 3y ago
But ChatGPT isn’t deciding to use fictional methodology in its paper, it’s being asked to generate a fictional methodology and complying. The human is the problem in that scenario, not the LLM. The unethical choice happens at the point of deciding to lie about methodology, before LLM is involved. It may seem like a meaningless distinction, but it’s the difference between LLMs causing trouble and people causing trouble, which is important for the larger debate.
- anonymous_sorry 3y ago
  Not meaningless, but a little obvious. I don't think anyone was accusing ChatGPT of being duplicitous. I think one problem with LLMs and the hype around them is that people are placing far too much confidence in them, and therefore misuse them. That it's even conceivable that people might blame a tool for unethical behaviour is an indicator of this. The idea that an LLM would be able to correctly generate your methodology for you is another. I find ChatGPT simultaneously incredible and terrible. It has no concept of what it knows and what it doesn't, so there's nothing I would trust it to do without a human checking the output.
- circuit10 3y ago
  This reminds me of when I asked it to generate a fake research paper describing how my dog is the best in the world as a joke and it refused because apparently creating fake research papers is unethical, even when it’s an obvious joke. I asked again in a new chat and it made me a really nice one with funny things like a formula showing the amount of force he uses to open doors and fake data proving statistically that he is the best
davely 3y ago
Yes, I agree. I misread the word. My apologies!

circuit10 3y ago

They mean generating fictional methodology and then passing it off as real in a scientific paper is unethical. This is also unethical if you don’t use ChatGPT, of course

davely 3y ago
Ah! Misunderstanding on my part. I see. Thank you!