4 ms·

It reads like “AI is dangerous, only we should be allowed to make money from it”

encyclopedism 13d ago
Exactly He doesn't need anyones permission to do so, go ahead no one is stopping you! If you feel so strongly about it, lead by example. Perhaps others will follow, maybe even China. Regardless backup your sentiment with actions!
- GeneralMayhem 13d ago
  There is a specific, unilateral action that he is taking described in the article. And the "why are they developing AI if they think it's so dangerous" argument is neither new nor persuasive. They're developing it because (1) they think the potential benefits are as great as the potential risks, and they know that if they aren't one of the actors on the frontier (2) they won't be able to propose meaningful solutions and (3) their opinions won't be taken seriously. Amodei is in rooms with powerful people to propose these things because Anthropic is successfully developing frontier models. The heads of various NGOs and advocacy groups that are concerned with AI safety but not themselves working on those systems are... nowhere, writing pamphlets and blogs that not you nor I nor anyone in Congress will ever read.
  - encyclopedism 13d ago
    I'll leave this here: https://x.com/DavidSacks/status/2098973625252708460 https://x.com/DavidSacks/status/2098973625252708460
    - reasonableklout 13d ago
      I mean, he is right that they can and should unilaterally slow down, but doesn't it also make sense for the government to create the regulations that will make this easier to do in a trustless way? The whole point of the Pacing the Frontier letter was that employees at both OpenAI and Anthropic are extremely aware of the risks but realize that they are locked in a competitive battle for survival between 2 companies that don't trust each other enough to voluntarily pause, while any sort of coordination out in the open might be against antitrust laws.
      - encyclopedism 12d ago
        > but doesn't it also make sense for the government to create the regulations that will make this easier to do in a trustless way? That's a premise, which is the point. Many (I) think the government should NOT enact regulations. For example regulatory capture to reducing competition is one reason it may not be a good idea to do what is being asked.
        GeneralMayhem 12d ago
        What other solution do you suggest to the coordination problem?
homieg33 13d ago
To me it reads like whoever can solve alignment should make money.
- giardini 12d ago
  To me it suggests that "alignment" is the problem as in "Alignment as implemented is a failure: we need to revisit our assumptions."

Exactly He doesn't need anyones permission to do so, go ahead no one is stopping you! If you feel so strongly about it, lead by example. Perhaps others will follow, maybe even China. Regardless backup your sentiment with actions!

GeneralMayhem 13d ago
There is a specific, unilateral action that he is taking described in the article. And the "why are they developing AI if they think it's so dangerous" argument is neither new nor persuasive. They're developing it because (1) they think the potential benefits are as great as the potential risks, and they know that if they aren't one of the actors on the frontier (2) they won't be able to propose meaningful solutions and (3) their opinions won't be taken seriously. Amodei is in rooms with powerful people to propose these things because Anthropic is successfully developing frontier models. The heads of various NGOs and advocacy groups that are concerned with AI safety but not themselves working on those systems are... nowhere, writing pamphlets and blogs that not you nor I nor anyone in Congress will ever read.
- encyclopedism 13d ago
  I'll leave this here: https://x.com/DavidSacks/status/2098973625252708460 https://x.com/DavidSacks/status/2098973625252708460
  - reasonableklout 13d ago
    I mean, he is right that they can and should unilaterally slow down, but doesn't it also make sense for the government to create the regulations that will make this easier to do in a trustless way? The whole point of the Pacing the Frontier letter was that employees at both OpenAI and Anthropic are extremely aware of the risks but realize that they are locked in a competitive battle for survival between 2 companies that don't trust each other enough to voluntarily pause, while any sort of coordination out in the open might be against antitrust laws.
    - encyclopedism 12d ago
      > but doesn't it also make sense for the government to create the regulations that will make this easier to do in a trustless way? That's a premise, which is the point. Many (I) think the government should NOT enact regulations. For example regulatory capture to reducing competition is one reason it may not be a good idea to do what is being asked.
      - GeneralMayhem 12d ago
        What other solution do you suggest to the coordination problem?

homieg33 13d ago

To me it reads like whoever can solve alignment should make money.

giardini 12d ago
To me it suggests that "alignment" is the problem as in "Alignment as implemented is a failure: we need to revisit our assumptions."