4 ms·
But ChatGPT isn’t deciding to use fictional methodology in its paper, it’s being asked to generate a fictional methodology and complying. The human is the prob
by WendyTheWillow 3y ago
But ChatGPT isn’t deciding to use fictional methodology in its paper, it’s being asked to generate a fictional methodology and complying.
The human is the problem in that scenario, not the LLM. The unethical choice happens at the point of deciding to lie about methodology, before LLM is involved.
It may seem like a meaningless distinction, but it’s the difference between LLMs causing trouble and people causing trouble, which is important for the larger debate.
- anonymous_sorry 3y agoNot meaningless, but a little obvious. I don't think anyone was accusing ChatGPT of being duplicitous. I think one problem with LLMs and the hype around them is that people are placing far too much confidence in them, and therefore misuse them. That it's even conceivable that people might blame a tool for unethical behaviour is an indicator of this. The idea that an LLM would be able to correctly generate your methodology for you is another. I find ChatGPT simultaneously incredible and terrible. It has no concept of what it knows and what it doesn't, so there's nothing I would trust it to do without a human checking the output.
- circuit10 3y agoThis reminds me of when I asked it to generate a fake research paper describing how my dog is the best in the world as a joke and it refused because apparently creating fake research papers is unethical, even when it’s an obvious joke. I asked again in a new chat and it made me a really nice one with funny things like a formula showing the amount of force he uses to open doors and fake data proving statistically that he is the best