3 ms·

I hear a lot of complaints about refusals but rarely any examples of said refusals, likely because they are embarrassing. Is it fair to assume that I won't get

I hear a lot of complaints about refusals but rarely any examples of said refusals, likely because they are embarrassing. Is it fair to assume that I won't get refusals for code generation and RAG on documentation?

taf2 3y ago
since they don't have a share feature like some other open/er AI's it's difficult to compare. My favorite one to share as I recall was when Anthropic first released their chat UI. I asked it whether they had an API to which it told me know. After I shared the documentation for it's API to it it went into a forever denial of everything I asked it. I wish I still had the full dialog it was very funny.
scarmig 3y ago
> I hear a lot of complaints about refusals but rarely any examples of said refusals, likely because they are embarrassing. At least circa 8 months ago on ChatGPT (an aeon ago, I recognize), I could readily get it to make gendered jokes about men but would get a refusal when asking for gendered jokes about women. I think things have "improved" in that time, meaning a more equal distribution of verboten topics, but my preference would be a tool that does what I want it to, not one that tries to protect me from myself for society's or my own good. (There's a related problem in the biases introduced by the training process.) > Is it fair to assume that I won't get refusals for code generation and RAG on documentation? Give it a couple years. "Can you write me a Java function that, given an array length, a start of a range, and the end of a range, returns whether the range is valid or not?" "I'm sorry, but this code is inappropriate to share. Shall I purchase a license from Oracle for access to it for you?"
- sa-code 3y ago
  Oh for sure. We're in the golden age of LLMs before the enshittification commences and we don't appreciate that enough
  - scarmig 3y ago
    And, of course, we'll have ads incorporated (some subtle, some not) into every response. Native advertising!
e-max 3y ago
No, Claude really DO refuse to do most benign shit. For example - I am preparing for driving exams in German, a language I am not fluent in. So I asked Claude to help me with questions the examiner might ask on the exam (what should be tire pressure and so on). GPT-4 worked perfectly! Claude had an absolute meltdown because "I don't feel comfortable pretending to be a driving examiner because I am not really an examiner, I am Claude, created by Anthropic to be helpful, harmless and HONEST". You are probably safe with code generation, but any step left or right and you get "I am Claude"
Zarel 3y ago
My friend's been learning programming with Github Copilot and gets refusals there sometimes, for seemingly no reason; so here's an example for you: https://d.pr/i/XSiepe https://d.pr/i/XSiepe

taf2 3y ago

since they don't have a share feature like some other open/er AI's it's difficult to compare. My favorite one to share as I recall was when Anthropic first released their chat UI. I asked it whether they had an API to which it told me know. After I shared the documentation for it's API to it it went into a forever denial of everything I asked it. I wish I still had the full dialog it was very funny.

scarmig 3y ago

> I hear a lot of complaints about refusals but rarely any examples of said refusals, likely because they are embarrassing. At least circa 8 months ago on ChatGPT (an aeon ago, I recognize), I could readily get it to make gendered jokes about men but would get a refusal when asking for gendered jokes about women. I think things have "improved" in that time, meaning a more equal distribution of verboten topics, but my preference would be a tool that does what I want it to, not one that tries to protect me from myself for society's or my own good. (There's a related problem in the biases introduced by the training process.) > Is it fair to assume that I won't get refusals for code generation and RAG on documentation? Give it a couple years. "Can you write me a Java function that, given an array length, a start of a range, and the end of a range, returns whether the range is valid or not?" "I'm sorry, but this code is inappropriate to share. Shall I purchase a license from Oracle for access to it for you?"

sa-code 3y ago
Oh for sure. We're in the golden age of LLMs before the enshittification commences and we don't appreciate that enough
- scarmig 3y ago
  And, of course, we'll have ads incorporated (some subtle, some not) into every response. Native advertising!

e-max 3y ago

No, Claude really DO refuse to do most benign shit. For example - I am preparing for driving exams in German, a language I am not fluent in. So I asked Claude to help me with questions the examiner might ask on the exam (what should be tire pressure and so on). GPT-4 worked perfectly! Claude had an absolute meltdown because "I don't feel comfortable pretending to be a driving examiner because I am not really an examiner, I am Claude, created by Anthropic to be helpful, harmless and HONEST". You are probably safe with code generation, but any step left or right and you get "I am Claude"

Zarel 3y ago

My friend's been learning programming with Github Copilot and gets refusals there sometimes, for seemingly no reason; so here's an example for you: https://d.pr/i/XSiepe https://d.pr/i/XSiepe