3 ms·
Briefly: - Developers must assess whether their AI models have hazardous capabilities before training them. They must also be capable of promptly shutting down
by gedy 3y ago
Briefly:
- Developers must assess whether their AI models have hazardous capabilities before training them. They must also be capable of promptly shutting down the model if safety concerns arise.
- Developers must annually certify compliance with safety requirements. They must report any AI safety incidents to a newly created Frontier Model Division within the Department of Technology.
- Cluster Operation Regulation: OOpolicies to assess whether customers intend to use the cluster for deploying AI models. Violations may lead to civil penalties.
- A new division within the Department of Technology will review developer certifications, release summarized findings, and may assess related fees.
- The Department of Technology will establish a public cloud computing cluster named CalCompute, focusing on safe and secure deployment of large-scale AI models and promoting equitable innovation.
- _heimdall 3y agoI don't work on ML directly so I'm definitely coming at it from a more general CS angle, but I wouldn't feel comfortable anywhere near the first two bullets. My outsider's understanding is that we really don't know specifically how the models learn what they learn or why they give specific answers. Is it possible that we could even know whether a model could present hazardous capabilities prior to training it? Or after it for that matter?
- gedy 3y agoyeah, my problem with a lot of these people pushing for “regulating“ AI is that they seem to always assume the organizations they are dealing with are big, well-funded corporations. But this will affect individual or open source developers in California just as well. It’s a really dumb proposal, hopefully it doesn’t go through.