3 ms·

"The final text asks some AI companies to submit their powerful new models to a voluntary government review 30 days before releasing the products to the public,

by pj_mukh 5mo ago

"The final text asks some AI companies to submit their powerful new models to a voluntary government review 30 days before releasing the products to the public, a pause that would give federal agencies some time to gauge what threats the products may pose to sensitive financial, national security and other computer systems." How specifically does that review work? I want to give federal agency Opus 4.8 now, while 4.7 has been out for a while (leaving Mythos aside for now). They have 30 days to figure out whether it poses a threat. How do you do that? Is there an eval for this and if there is why can't they just make it public? What is the agencies objective (but proprietary?) analysis here?

onlyrealcuzzo 5mo ago
It's just so Elon Musk gets to personally delay releases so Grok can maybe ever gain any meaningful traction...
- sethops1 5mo ago
  Also to probably distill from other models, as he admitted to already doing during his failed trial against OpenAI.
  - sidewndr46 5mo ago
    Do you have a link to that?
    - unshavedyak 5mo ago
      Not the parent, but i assume these are relevant: - https://web.archive.org/web/20260602130637/https://www.technologyreview.com/2026/05/01/1136800/musk-v-altman-week-1-musk-says-he-was-duped-warns-ai-could-kill-us-all-and-admits-that-xai-distills-openais-models/ https://web.archive.org/web/20260602130637/https://www.techn... - https://web.archive.org/web/20260520190620/https://fortune.com/2026/05/05/musk-court-fight-openai/ https://web.archive.org/web/20260520190620/https://fortune.c...
ranger_danger 5mo ago
It's in the text of the order, it directs NIST to: > develop and maintain a classified benchmarking process to assess the advanced cyber capabilities of AI models and determine the threshold at which an AI model should be designated a “covered frontier model” for the purposes of this order
TylerE 5mo ago
> Is there an eval for this and if there is why can't they just make it public? For the same reason the CIA doesn't publish the Windows exploits it finds?
- oneshtein 5mo ago
  To keep domestic systems vulnerable to enemy attacks?
pesus 5mo ago
I seriously doubt even the government actually knows or has a real plan, let alone one actually related to security. If it's anything like their track record, they'll just be asking the AI about a topic related to their enemies (i.e. anyone opposed to them in any way) to see if it says anything remotely positive about them, or anything remotely critical of the regime or out of line with the regime's "alternative facts".
- baggachipz 5mo ago
  That and I'm sure these companies could circumvent the mandatory review if they make certain... donations.
  - deleted 5mo ago
    [deleted]
_puk 5mo ago
Just do a VW and detect when you might be in the testing phase. Off the top of my head: Train it dumb on "systems:, user:" prompt pairs. Unleash on "system:, user:" prompt pairs. Guess which you're providing for evaluation.
clear-octopus 5mo ago
[dead]
karmasimida 5mo ago
Self-report and self regulation, kind of like Boeing with FAA ... so not functional in long term
voganmother42 5mo ago
The review is they ask it about the epstein files and ensure any other politically sensitive topics have the “right” answers.
frabcus 5mo ago
AISI in the UK has been doing this for years - there are lots of papers https://www.aisi.gov.uk/category/safeguards https://www.aisi.gov.uk/category/safeguards and specific reports, e.g. this on GPT 5.5 https://www.aisi.gov.uk/blog/our-evaluation-of-openais-gpt-5-5-cyber-capabilities https://www.aisi.gov.uk/blog/our-evaluation-of-openais-gpt-5... This old post goes into lots of detail about what they do to red team and why: https://www.aisi.gov.uk/blog/early-lessons-from-evaluating-frontier-ai-systems https://www.aisi.gov.uk/blog/early-lessons-from-evaluating-f... NIST's similar unit in the US is now called CAISI https://www.nist.gov/caisi https://www.nist.gov/caisi - interesting that the most recent post is an evaluation of DeepSeek capabilities, which sound more like watching China. But presumably this executive order alters the emphasis?

by pj_mukh 5mo ago

onlyrealcuzzo 5mo ago

It's just so Elon Musk gets to personally delay releases so Grok can maybe ever gain any meaningful traction...

sethops1 5mo ago
Also to probably distill from other models, as he admitted to already doing during his failed trial against OpenAI.
- sidewndr46 5mo ago
  Do you have a link to that?
  - unshavedyak 5mo ago
    Not the parent, but i assume these are relevant: - https://web.archive.org/web/20260602130637/https://www.technologyreview.com/2026/05/01/1136800/musk-v-altman-week-1-musk-says-he-was-duped-warns-ai-could-kill-us-all-and-admits-that-xai-distills-openais-models/ https://web.archive.org/web/20260602130637/https://www.techn... - https://web.archive.org/web/20260520190620/https://fortune.com/2026/05/05/musk-court-fight-openai/ https://web.archive.org/web/20260520190620/https://fortune.c...

ranger_danger 5mo ago

It's in the text of the order, it directs NIST to: > develop and maintain a classified benchmarking process to assess the advanced cyber capabilities of AI models and determine the threshold at which an AI model should be designated a “covered frontier model” for the purposes of this order

TylerE 5mo ago

> Is there an eval for this and if there is why can't they just make it public? For the same reason the CIA doesn't publish the Windows exploits it finds?

oneshtein 5mo ago
To keep domestic systems vulnerable to enemy attacks?

pesus 5mo ago

I seriously doubt even the government actually knows or has a real plan, let alone one actually related to security. If it's anything like their track record, they'll just be asking the AI about a topic related to their enemies (i.e. anyone opposed to them in any way) to see if it says anything remotely positive about them, or anything remotely critical of the regime or out of line with the regime's "alternative facts".

baggachipz 5mo ago
That and I'm sure these companies could circumvent the mandatory review if they make certain... donations.
- deleted 5mo ago
  [deleted]

_puk 5mo ago

Just do a VW and detect when you might be in the testing phase. Off the top of my head: Train it dumb on "systems:, user:" prompt pairs. Unleash on "system:, user:" prompt pairs. Guess which you're providing for evaluation.

clear-octopus 5mo ago

[dead]

karmasimida 5mo ago

Self-report and self regulation, kind of like Boeing with FAA ... so not functional in long term

voganmother42 5mo ago

The review is they ask it about the epstein files and ensure any other politically sensitive topics have the “right” answers.

frabcus 5mo ago

AISI in the UK has been doing this for years - there are lots of papers https://www.aisi.gov.uk/category/safeguards https://www.aisi.gov.uk/category/safeguards and specific reports, e.g. this on GPT 5.5 https://www.aisi.gov.uk/blog/our-evaluation-of-openais-gpt-5-5-cyber-capabilities https://www.aisi.gov.uk/blog/our-evaluation-of-openais-gpt-5... This old post goes into lots of detail about what they do to red team and why: https://www.aisi.gov.uk/blog/early-lessons-from-evaluating-frontier-ai-systems https://www.aisi.gov.uk/blog/early-lessons-from-evaluating-f... NIST's similar unit in the US is now called CAISI https://www.nist.gov/caisi https://www.nist.gov/caisi - interesting that the most recent post is an evaluation of DeepSeek capabilities, which sound more like watching China. But presumably this executive order alters the emphasis?