4 ms·

HN thinks the safety crowd is dumb, and has never seriously engaged with the AI safety space. HN doesn't believe superintelligence will be a thing; while the A

HN thinks the safety crowd is dumb, and has never seriously engaged with the AI safety space. HN doesn't believe superintelligence will be a thing; while the AI safety crowd believes they are building it. So the decisionmaking of the safety crowd is incomprehensible to HN.

DrewADesign 4mo ago
Reductionist. Many of us think they’re all dumb.
pseudony 4mo ago
[flagged]
- SubiculumCode 4mo ago
  There is no reason for you to make personal attacks like that. Not on HN. Moreover, your take on Dario is over simplistic, and undersells the extent to which Anthropic takes seriously safety. It's not lip service, there are real dollars and attention spent on alignment at Anthropic.
- solenoid0937 4mo ago
  It's clear you haven't engaged with the subject matter beyond the typical "internet-forum cynic" mindset. Both companies were founded on the basis of AI Safety. - There are tons of great safety people doing real work at OpenAI. Releases are held back, models are evaluated, etc. - Anthropic goes even further - constrained themselves with a PBC/LTBT structure, treat safety even more rigorously, and notably delayed the release of Mythos (literally the opposite of what you alleged) and continue to hold their two red lines despite threats from the gov. You should actually talk to some of the people at these labs. Nearly everyone working at these places genuinely believe AGI/ASI is actually happening, so they do take safety seriously. To imply these companies don't care about safety is typical internet-brand nihilism/cynicism that helps you feel smart while being literally the opposite of the truth.
  - cyral 4mo ago
    To add to this, they should look at the Fable system card. It's 317 pages and it's clear how serious they are taking AI safety.
    - superb_dev 4mo ago
      Page count is not a measure of how seriously something is being taken when you can easily generate pages and pages of slop
      - solenoid0937 4mo ago
        You'd have a point if the report was pages of slop, but it clearly is not.
rvba 4mo ago
What is the AI safety crowd exactly? Dont we have a thread here how the model allegedly leaks responses what is "normal" safety? (Not "agi will become skynet" safety - what is mostly a rehash of terminator 2 story)
- nozzlegear 4mo ago
  According to their comment history, the person you're replying to believes that AGI, ASI, "superintelligence" and all of that sci-fi terminator what-have-you is not only possible, but literally inevitable. They're not worried about normal safety, they're worried about Skynet and the T-1000. American AI labs – Anthropic in particular – are apparently playing the role of Sara and/or John Connor in this story.
root_axis 4mo ago
> the AI safety crowd believes they are building it Stated without a hint of irony.

DrewADesign 4mo ago

Reductionist. Many of us think they’re all dumb.

pseudony 4mo ago

[flagged]

SubiculumCode 4mo ago
There is no reason for you to make personal attacks like that. Not on HN. Moreover, your take on Dario is over simplistic, and undersells the extent to which Anthropic takes seriously safety. It's not lip service, there are real dollars and attention spent on alignment at Anthropic.
solenoid0937 4mo ago
It's clear you haven't engaged with the subject matter beyond the typical "internet-forum cynic" mindset. Both companies were founded on the basis of AI Safety. - There are tons of great safety people doing real work at OpenAI. Releases are held back, models are evaluated, etc. - Anthropic goes even further - constrained themselves with a PBC/LTBT structure, treat safety even more rigorously, and notably delayed the release of Mythos (literally the opposite of what you alleged) and continue to hold their two red lines despite threats from the gov. You should actually talk to some of the people at these labs. Nearly everyone working at these places genuinely believe AGI/ASI is actually happening, so they do take safety seriously. To imply these companies don't care about safety is typical internet-brand nihilism/cynicism that helps you feel smart while being literally the opposite of the truth.
- cyral 4mo ago
  To add to this, they should look at the Fable system card. It's 317 pages and it's clear how serious they are taking AI safety.
  - superb_dev 4mo ago
    Page count is not a measure of how seriously something is being taken when you can easily generate pages and pages of slop
    - solenoid0937 4mo ago
      You'd have a point if the report was pages of slop, but it clearly is not.

rvba 4mo ago

What is the AI safety crowd exactly? Dont we have a thread here how the model allegedly leaks responses what is "normal" safety? (Not "agi will become skynet" safety - what is mostly a rehash of terminator 2 story)

nozzlegear 4mo ago
According to their comment history, the person you're replying to believes that AGI, ASI, "superintelligence" and all of that sci-fi terminator what-have-you is not only possible, but literally inevitable. They're not worried about normal safety, they're worried about Skynet and the T-1000. American AI labs – Anthropic in particular – are apparently playing the role of Sara and/or John Connor in this story.

root_axis 4mo ago

> the AI safety crowd believes they are building it Stated without a hint of irony.