4 ms·

> They're actively trying to use lobbying power to make open weight models illegal. What is your evidence?

jimbo808 4mo ago
https://www.judiciary.senate.gov/imo/media/doc/2023-07-26_-_testimony_-_amodei.pdf https://www.judiciary.senate.gov/imo/media/doc/2023-07-26_-_... https://xcancel.com/coinbureau/status/2071330294452666695 https://xcancel.com/coinbureau/status/2071330294452666695 https://www.techpolicy.press/transcript-senate-hearing-on-principles-for-ai-regulation/ https://www.techpolicy.press/transcript-senate-hearing-on-pr... > "Once the weights of a model are public, they cannot be retrieved. If a model possesses dangerous capabilities, it is permanently out in the wild... We need to consider regulatory frameworks that account for the unique risks of open-source distribution of highly capable frontier models."
- TurdF3rguson 4mo ago
  That's true I guess. If someone decides a model needs more guard rails, anthropic can adjust it, whereas with open weights it's too late. It definitely sounds like the kind of thing that ends the world in B sci-fi thrillers.
  - TurdF3rguson 4mo ago
    Curious if I'm being downvoted by people who think there will never be a model with dangerous capabilities? Or people who think when it happens we shouldn't add guard rails?
Robdel12 4mo ago
Dario’s own mouth https://x.com/coinbureau/status/2071330294452666695/mediaviewer https://x.com/coinbureau/status/2071330294452666695/mediavie...
- jquery 4mo ago
  Yeesh. “What shall we do sire, when the peasants learn to read?” vibes
  - entropicdrifter 4mo ago
    You mean to tell me that anyone can own a nail-gun? We can't have people buying their own nail-guns, next thing you know they might build things that aren't up to code!
- anon373839 4mo ago
  He has also been telling bald-faced lies about open source/open weights models that are easily disproved. For example, he claimed that they lack the collaborative benefits of open source because "we can't see inside the model". Open weights models are responsible for enabling reams of research on interpretability methods that do just that. And they have facilitated so much collaboration on architecture, inference optimizations, training and steering methods, and other topics that were completely out of reach with closed models like Anthropic's. It's really staggering to me.
  - andsoitis 4mo ago
    Doesn’t this seem true / self-evident: “His warns that once powerful models are released openly, companies lose the ability to monitor misuse, revoke access, or update safety guardrails.”
    - anon373839 4mo ago
      The premise (that "powerful models" implicate "safety" concerns that must be controlled by "companies") does not seem true or self-evident to me. This tired fearmongering campaign centered on GPT-4 three years ago, a model now surpassed by open models that run on laptops. Did fearmongers like Amodei say, "Oops, we were wrong! It wasn't that dangerous after all"? No. Of course they didn't.
    - regularfry 4mo ago

https://www.judiciary.senate.gov/imo/media/doc/2023-07-26_-_testimony_-_amodei.pdf https://www.judiciary.senate.gov/imo/media/doc/2023-07-26_-_... https://xcancel.com/coinbureau/status/2071330294452666695 https://xcancel.com/coinbureau/status/2071330294452666695 https://www.techpolicy.press/transcript-senate-hearing-on-principles-for-ai-regulation/ https://www.techpolicy.press/transcript-senate-hearing-on-pr... > "Once the weights of a model are public, they cannot be retrieved. If a model possesses dangerous capabilities, it is permanently out in the wild... We need to consider regulatory frameworks that account for the unique risks of open-source distribution of highly capable frontier models."

TurdF3rguson 4mo ago
That's true I guess. If someone decides a model needs more guard rails, anthropic can adjust it, whereas with open weights it's too late. It definitely sounds like the kind of thing that ends the world in B sci-fi thrillers.
- TurdF3rguson 4mo ago
  Curious if I'm being downvoted by people who think there will never be a model with dangerous capabilities? Or people who think when it happens we shouldn't add guard rails?

Robdel12 4mo ago

Dario’s own mouth https://x.com/coinbureau/status/2071330294452666695/mediaviewer https://x.com/coinbureau/status/2071330294452666695/mediavie...

jquery 4mo ago
Yeesh. “What shall we do sire, when the peasants learn to read?” vibes
- entropicdrifter 4mo ago
  You mean to tell me that anyone can own a nail-gun? We can't have people buying their own nail-guns, next thing you know they might build things that aren't up to code!
anon373839 4mo ago
He has also been telling bald-faced lies about open source/open weights models that are easily disproved. For example, he claimed that they lack the collaborative benefits of open source because "we can't see inside the model". Open weights models are responsible for enabling reams of research on interpretability methods that do just that. And they have facilitated so much collaboration on architecture, inference optimizations, training and steering methods, and other topics that were completely out of reach with closed models like Anthropic's. It's really staggering to me.
- andsoitis 4mo ago
  Doesn’t this seem true / self-evident: “His warns that once powerful models are released openly, companies lose the ability to monitor misuse, revoke access, or update safety guardrails.”
  - anon373839 4mo ago
    The premise (that "powerful models" implicate "safety" concerns that must be controlled by "companies") does not seem true or self-evident to me. This tired fearmongering campaign centered on GPT-4 three years ago, a model now surpassed by open models that run on laptops. Did fearmongers like Amodei say, "Oops, we were wrong! It wasn't that dangerous after all"? No. Of course they didn't.
  - regularfry 4mo ago