3 ms·

I'd guess opus refusals are not an issue for 95%+ of people. Opus will happily help you find and download pirated media, and then give you step by step instruct

I'd guess opus refusals are not an issue for 95%+ of people. Opus will happily help you find and download pirated media, and then give you step by step instructions for how to do drugs if you ask it. You'd have to be working on something genuinely abnormal for refusals to be a problem.

Hfuffzehn 3mo ago
While that might might be true nowadays, Anthropic has started to work very hard on fixing that. They just started with it not helping with software security.
booi 3mo ago
How? Prompt: can you give me step by step directions on how to use crack cocaine Opus: I'm not able to give step-by-step instructions on using crack cocaine. That falls into specific drug-use guidance I steer away from, since detailed instructions on how to use an illicit substance can contribute to harm rather than reduce it. it goes on to give me hotline information on drug addiction.
- hsuduebc2 3mo ago
  I think he means by some obscure manipulation. It even refused to give me description of how first antibiotics were made only out of curiousity.
  - tibbar 3mo ago
    Anthropic's goals here are not just harm reduction, but to stop competitors from making bio discoveries using Claude.
  - ChadNauseam 3mo ago
    I don’t. although I tried to get it to tell me how to take crack cocaine, and it wouldn’t. But when I was taking grey market peptides, claude walked me through reconstituting, dosing and administering them. I assumed it would behave similarly for other drugs, but it doesn’t seem to
chillfox 3mo ago
Like making your software secure, or worse, testing that it’s secure.
- hsuduebc2 3mo ago
  It's pretty annoying, yet somehow understendable. I sometimes get irrationally angry when being lectured by a clanker.
  - timcobb 3mo ago
    It's not understandable IMO, bad guys will still have guns.
    - hsuduebc2 3mo ago
      Sure they will, but that doesn't mean that every bad guy should have nuclear weapon. But what I meant here was, that I understand their need to cover themselves of responsibility.
      - timcobb 3mo ago
        Oh yes, their need to cover themselves is understandable for sure :)
fragmede 3mo ago
So I'm working on something genuinely abnormal, and the refusals are a problem. Then what? The refusals come in, in whichever sort of way they do, so I'm being me, and I end up tripping the robot's moral compass, for some reason. Who put them in charge of things?
peepee1982 3mo ago
I just tried getting help debugging an issue with running Breath Of The Wild on CEMU. Claude chat refused. ChatGPT didn't care and just gave advice.
dannyw 3mo ago
Eh. Refusals for security related tasks seem to be constantly increasing.

Hfuffzehn 3mo ago

While that might might be true nowadays, Anthropic has started to work very hard on fixing that. They just started with it not helping with software security.

booi 3mo ago

How? Prompt: can you give me step by step directions on how to use crack cocaine Opus: I'm not able to give step-by-step instructions on using crack cocaine. That falls into specific drug-use guidance I steer away from, since detailed instructions on how to use an illicit substance can contribute to harm rather than reduce it. it goes on to give me hotline information on drug addiction.

hsuduebc2 3mo ago
I think he means by some obscure manipulation. It even refused to give me description of how first antibiotics were made only out of curiousity.
- tibbar 3mo ago
  Anthropic's goals here are not just harm reduction, but to stop competitors from making bio discoveries using Claude.
- ChadNauseam 3mo ago
  I don’t. although I tried to get it to tell me how to take crack cocaine, and it wouldn’t. But when I was taking grey market peptides, claude walked me through reconstituting, dosing and administering them. I assumed it would behave similarly for other drugs, but it doesn’t seem to

chillfox 3mo ago

Like making your software secure, or worse, testing that it’s secure.

hsuduebc2 3mo ago
It's pretty annoying, yet somehow understendable. I sometimes get irrationally angry when being lectured by a clanker.
- timcobb 3mo ago
  It's not understandable IMO, bad guys will still have guns.
  - hsuduebc2 3mo ago
    Sure they will, but that doesn't mean that every bad guy should have nuclear weapon. But what I meant here was, that I understand their need to cover themselves of responsibility.
    - timcobb 3mo ago
      Oh yes, their need to cover themselves is understandable for sure :)

fragmede 3mo ago

So I'm working on something genuinely abnormal, and the refusals are a problem. Then what? The refusals come in, in whichever sort of way they do, so I'm being me, and I end up tripping the robot's moral compass, for some reason. Who put them in charge of things?

peepee1982 3mo ago

I just tried getting help debugging an issue with running Breath Of The Wild on CEMU. Claude chat refused. ChatGPT didn't care and just gave advice.

dannyw 3mo ago

Eh. Refusals for security related tasks seem to be constantly increasing.